模型40

GPT-6.2 Astra 与 Sol 编码智能体指数表现

原标题:GPT-6.2 Astra is flat with GPT-6 Astra, and GPT-6.2 Sol loses 3 points relative to GPT-6.1 Sol in the Artificial Analysis Coding Agent In...

Artificial Analysis@ArtificialAnlys发布时间 (北京时间)

在 Artificial Analysis 编码智能体指数中(Codex harness 以最大 effort 运行),GPT-6.2 Astra 与 GPT-6 Astra 持平,而 GPT-6.2 Sol 相对 GPT-6.1 Sol 下降 3 分。对 Sol 而言,这一下降由 SWE-Atlas-QnA-AA 上 14 分的下滑所致——在该项上,该模型比其前代更可能在回答中遗漏关键事实。

中文译文尚未完成,先为你展示原文。

GPT-6.2 Astra is flat with GPT-6 Astra, and GPT-6.2 Sol loses 3 points relative to GPT-6.1 Sol in the Artificial Analysis Coding Agent Index (Codex harness at max effort). For Sol, the drop is driven by a 14-point drop in SWE-Atlas-QnA-AA, where the model is more likely than its predecessor to omit key facts in its responses.

OpenAI / ChatGPTAI 编码评测基准#评测/基准#编码#OpenAI

同一件事的其他报道2 篇