ReTerm:自我修复终端智能体训练方法
ReTerm: Recovery Training for Self-Improving Terminal Agents
ReTerm能从自身错误中学习,终端任务恢复能力提升显著
ReTerm是基于Qwen3.5-9B构建的终端智能体,在Terminal-Bench 2.0基准测试上达到34.8%的Pass@1分数,比基础模型提升14.6个百分点。该模型通过ReTerm-10K数据集学习从失败中恢复,采用ReTerm-GRPO在线强化学习算法。研究显示,ReTerm在各类错误恢复率上均优于标准GRPO训练方法。
ReTerm: Recovery Training for Self-Improving Terminal Agents
Terminal agents have shown strong abilities in complex coding tasks. However, they often struggle to recover from errors during long-running execution (e.g., command errors, faulty implementations), eventually leading to task failures. To this end, we present ReTerm, a self-improving terminal agent trained by learning how to recover from its own failed terminal tasks. To support its training, we construct a customized data pipeline and produce ReTerm-10K, a high-quality dataset that provides effective recovery demonstrations for SFT cold start. Furthermore, we propose ReTerm-GRPO, an online RL algorithm that forks from the agent's own failure states to generate multiple independent self-recovery attempts. By learning from whether these attempts successfully complete the task, the agent self-improves through its own recovery experience. Built on Qwen3.5-9B, our ReTerm-9B achieves 34.8% Pass@1 on Terminal-Bench 2.0, improving over the base model by 14.6 points. Further analysis shows that our method achieves consistently higher recovery rates across diverse error categories compared with standard GRPO training. All code, data and model are released at https://github.com/twothsnd/ReTerm.
- 宝玉10-13 03:05原文