模型58

ARC Prize 公布 Sol 在 ARC-AGI-3 得分 98.2%、成本低于 Astra

原标题:Sol's best ARC-AGI-3 score of 98.2% at high reasoning was 1.8 percentage points behind Astra's 100% score at max reasoning, but at 64% lo...

ARC Prize@arcprize发布时间 (北京时间)

ARC Prize 公布 Sol 在 ARC-AGI-3 高推理档位下得分 98.2%,比 Astra 在最高推理档位的 100% 低 1.8 个百分点,但成本低 64%。使用 provider adapter 时,ARC-AGI-3 成绩为 98.2%、花费 $1.5K,标准配置下为 54.9%、$5.5K;ARC-AGI-2 为 85.8%、$0.13/task,ARC-AGI-1 为 97.5%、$0.06/task。

中文译文尚未完成,先为你展示原文。

Sol's best ARC-AGI-3 score of 98.2% at high reasoning was 1.8 percentage points behind Astra's 100% score at max reasoning, but at 64% lower cost with the provider adapter harness:

  • ARC-AGI-3: 98.2%, $1.5K (provider adapter), 54.9%, $5.5K (standard)
  • ARC-AGI-2: 85.8%, $0.13/task
  • ARC-AGI-1: 97.5%, $0.06/task

Full results: https://arcprize.org/results/openai-gpt-6-2

OpenAI / ChatGPT评测基准#评测/基准#OpenAI

同一件事的其他报道3 篇