CUA-Master:开源世界递归改进框架训练 27B 计算机操作智能体
CUA-Master: Scaling Computer-use Agents through Open-World Recursive Improvements
一篇计算机操作智能体的论文,思路挺有意思:从教学视频里挖真实工作流当种子任务,再用快照回滚机制采集轨迹,27B 模型在 OSWorld Verified 拿到 80.2 分。
arXiv 论文提出 CUA-Master,一个嵌套双循环递归改进框架。外循环是“世界-数据-模型”飞轮,持续吸收开放世界语料并根据模型弱点引导数据构建;内循环从教学视频挖掘真实工作流作为种子任务,再用视觉-语义双路径轨迹重建和自催化传播合成可验证任务。轨迹收集环节加入反馈引导的快照回滚重试机制。CUA-Master-27B 在 OSWorld Verified 得 80.2 分,OSWorld 2.0 得 36.9 分,WeaveBench 得 43.9 分,Agents' Last Exam 得 25.0 分,覆盖 GUI-only 和 GUI-CLI 混合两类基准。
CUA-Master: Scaling Computer-use Agents through Open-World Recursive Improvements
Despite recent advances in CUAs, their development remains constrained by the limited diversity, controllability, and reliability of interaction data. Moreover, conventional optimization pipelines lack iterative feedback, while existing recursive improvement approaches often rely on self-generated experiences, limiting ability expansion and yielding diminishing returns. To address these challenges, we introduce CUA-Master, a nested double-loop recursive improvement framework. At the system level, an outer world-data-model flywheel continuously incorporates open-world corpus and leverages evolving model weaknesses to guide subsequent data construction and optimization iterations. At the data level, an inner flywheel couples open-world seeding and autocatalytic propagation. The former mines authentic workflows as seed tasks from instructional videos, and employs visual-semantic dual-path trajectory reconstruction; The latter transforms these seeds into reusable primitives for controllable synthesis of diverse, complex, and verifiable tasks. To enable efficient and reliable trajectory collection, we further introduce a feedback-guided snapshot-rollback retry mechanism in various real environments. Extensive experiments demonstrate that CUA-Master-27B achieves competitive performance across GUI-only and GUI-CLI hybrid benchmarks, scoring 80.2 on OSWorld Verified, 36.9 on OSWorld 2.0, 43.9 on WeaveBench, and 25.0 on Agents' Last Exam. Our framework also substantially improves the quality and efficiency of data synthesis, and exhibits continuous gains across recursive iterations.