论文58

Amazon 论文发现环境变化后智能体技能会失效并给出修复方法

原标题:New Amazon paper finds that saved agent skills can hurt once the environment changes, and checking and repairing them selectively restore...

Rohan Paul@rohanpaul_ai发布时间 (北京时间)

Amazon 一篇新论文发现,保存下来的智能体技能在环境变化后可能反而有害,选择性检查与修复能恢复其价值。研究在 Terminal-Bench 2 和 IRS 税表等 4 个设置上测试 Claude Opus 4.7 与 Haiku 4.5,修复方法无需模型调用即可重放已保存的检查,只修复或重建冲突的技能内容。

中文译文尚未完成,先为你展示原文。

New Amazon paper finds that saved agent skills can hurt once the environment changes, and checking and repairing them selectively restores their value.

Agent skills store past experience, like file paths, field names, or commands, so agents can skip work later. When an app or API changes, some of that stored detail goes stale without warning.

They tested Claude Opus 4.7 and Haiku 4.5 on 4 settings, including Terminal-Bench 2 and IRS tax forms, before and after a change. Their fix replays saved checks witho1ut model calls and repairs or rebuilds only the conflicting skill content.

On Terminal-Bench 2, a skill that had added 4.7 points for Opus cut its pass rate 11.4 points below no skill after the change. Maintenance lifted Haiku's tax-form field accuracy from 30.5% with the stale skill to 97.5%.

Check saved agent skills against the current environment before reuse, instead of waiting for tasks to fail.

Agent 智能体论文研究评测基准#论文/研究#Agent#评测/基准