论文38
Arena 推出 FrontierCS 2:智能体能否超越已发表 CS 研究
原标题:Can AI agents outperform published CS research, without even seeing the original paper?
UC Berkeley 博士生 MangQiuyang 与 lihanc02 在 Arena HQ 介绍 FrontierCS 2,该基准要求 AI 智能体在看不到原论文、无网络访问的条件下超越已发表方法。讨论涵盖成本与性能权衡及评测作弊问题,例如用搜索绕过强化学习、复用缓存的图算法结果。
中文译文尚未完成,先为你展示原文。
Can AI agents outperform published CS research, without even seeing the original paper?
UC Berkeley PhD candidates @MangQiuyang and @lihanc02 joined us at Arena HQ to introduce FrontierCS 2: a benchmark challenging agents to beat published methods without the paper or web access.
They discuss cost versus performance and evaluation exploits, from bypassing reinforcement learning with search to reusing cached graph-algorithm results.
Watch to learn what reliable evaluation requires and why human research judgment still matters.
