精选模型78

https://x.com/arena/status/2120568144687460434?a=KMB_myHkZq3NfqAnffE&s=20

Arena.ai@arena发布时间 (北京时间)

https://x.com/arena/status/2120568144687460434?a=KMB_myHkZq3NfqAnffE&s=20

中文译文尚未完成,先为你展示原文。

重大消息:@AnthropicAI 的 Claude Fable 5.2 (Max) 以空前的领先优势在 Agent Arena 中夺得第 1 名:净提升 +30.4%,约为第 2 名模型 Opus-5.5 的 1.6 倍,覆盖我们全球社区 4.7k 个真实世界智能体会话。它还在 Code、Chat 和 Work 中排名第 1。 相较 Claude Fable 5.1 (Max) 的重大飞跃 - 排名:#5 → #1,净提升:+14.8% → +30.4% - 每任务成本中位数:$7.7 → $7.3(降低 6%)。API 定价 $10/$50 → $8/$40 每百万输入/输出 token(降低 20%) 对比前沿模型 - #1 Claude Fable 5.1 (Max):+30.4% | $7.3/任务 - #2 Claude Opus 5.5 (Max):+19.5%) | $5.5/任务 - #3 Gemini 4 Carbon (High):+17.0%) | $1.5/任务 - #6 GPT-6-Astra (Max):+14.5% | $6.0/任务 按信号细分表现: Fable 5.2 在全部四项报告信号上均优于 5.1,其中用户满意度和可控性提升尤为显著。 - #1 表扬 vs. 投诉,+73%,相较下一模型的 +41% 为最大跃升。 - #1 可控性:+33% - #1 确认成功:+22% - #3 Bash 可靠性:+14% 在所有主要类别中排名第 1 - #1 Code:+34% - #1 Work:+31% - #1 Chat:+27% - 对比 Fable 5.1:Code #6 → #1(+19.8 %),Work #4 → #1(+15.8 %),Chat #6 → #1(+12.0%)。 热烈祝贺 @AnthropicAI 团队带来这一令人难以置信的发布!
查看原文

Big news: Claude Fable 5.2 (Max) by @AnthropicAI takes #1 in Agent Arena with an unprecedented lead: +30.4% net improvement, about 1.6x the #2 model Opus-5.5, across 4.7k real-world agentic sessions from our global community. It's also #1 in Code, Chat and Work. A major leap over Claude Fable 5.1 (Max) - Rank: #5 → #1, Net improvement: +14.8% → +30.4% - Median cost per task: $7.7 → $7.3 (6% lower). The API pricing $10/$50 → $8/$40 per million input/output tokens (20% lower) vs. The Frontiers - #1 Claude Fable 5.1 (Max): +30.4% | $7.3/task - #2 Claude Opus 5.5 (Max):+19.5%) | $5.5/task - #3 Gemini 4 Carbon (High):+17.0%) | $1.5/task - #6 GPT-6-Astra (Max): +14.5% | $6.0/task Breaking down performance across signals: Fable 5.2 improves over 5.1 across all four reported signals, with particularly large gains in user satisfaction and steerability. - #1 Praise vs. Complaint , +73%, biggest jump vs +41% the next model. - #1 Steerability: +33% - #1 Confirmed Success: +22% - #3 Bash Reliability: +14% #1 across all major categories - #1 Code: +34% - #1 Work: +31% - #1 Chat: +27% - Versus Fable 5.1: Code #6 → #1 (+19.8 %), Work #4 → #1 (+15.8 %), Chat #6 → #1 (+12.0%). Huge congrats to the @AnthropicAI team on this incredible release!

查看原帖
Anthropic / ClaudeAgent 智能体AI 编码评测基准#评测/基准#Agent#编码#Anthropic