模型58

Arena.ai 推出 Agent Arena Index 及六个细分指数

原标题:Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused...

Arena.ai@arena发布时间 (北京时间)

Arena.ai 推出 Agent Arena Index 及 Agentic Work、Coding、Chat、Task Outcomes、Tool Use、Steering 六个细分指数,与 Alignment Index 一起衡量智能体在真实任务中的表现。

中文译文尚未完成,先为你展示原文。

Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.

Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.

Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.

Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:

  • #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts
  • #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts
  • #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts
  • #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts
  • #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts

The Agent Arena Index combines four key signals of real-world agent performance:
- Task Completion: explicit confirmation of task success from users
- Praise vs. Complaint: user satisfaction with agent's outcome
- Bash Reliability: how well an agent uses terminal tools
- Steerability: how well an agent responds to user corrections

Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.

As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.

Explore the rankings and see what each index measures in the thread below.

https://x.com/i/article/2123122245950418945
查看原帖
Agent 智能体评测基准#评测/基准#Agent#Anthropic#Google#OpenAI#Meta

同一件事的其他报道3 篇