论文
38AI 评分(两次独立评分的平均)

METR 用指数查趋势变化

原标题:We used this index to look for trend changes. We can see anything from slight deceleration to moderate acceleration depending on methodol...

METR@METR_Evals发布时间 (北京时间)

我们用这个指数来寻找趋势变化。根据方法选择的不同,我们能看到从轻微减速到中度加速的各种结果。我们的数据只用到 9 月的公开模型,因此无法直接与“AECI 上 2 倍加速”的结果相比较。 https://x.com/METR_Evals/status/2118412205662314935

中文译文尚未完成,先为你展示原文。

We used this index to look for trend changes. We can see anything from slight deceleration to moderate acceleration depending on methodological choices. Our data only uses public models up to September, so is not directly comparable to the “2x acceleration on AECI” result.
https://x.com/METR_Evals/status/2118412205662314935

1. Benchmarks provide one piece of evidence for acceleration. Since Oct 2025, AECI scores for Anthropic’s models have grown at 1.9x [95%: 1.5–2.8] the earlier rate. Analysis choices affect this estimate, and it remains unclear how benchmark scores map to real-world capabilities.
查看原帖
论文研究评测基准现象与趋势#论文/研究#评测/基准#现象/趋势