WildAWM:用开源模型合成计算机操作智能体训练环境
Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
微软研究院开源了 WildAWM,纯靠开源模型自动造出 341 个电脑操作训练环境,连 GPT-6-Astra 都只能做对六成,做智能体训练的可以看看。
WildAWM 提出一条环境合成流水线,为计算机操作智能体生成可执行训练环境,同时支持图形界面、MCP 服务和命令行三种交互接口。整个流水线完全由开源模型驱动,不依赖专有前沿模型。通过执行式质量门控解决任务可解性、难度和验证器可靠性三个问题,最终合成 341 个长程环境-任务对,部分任务需要超过 100 步智能体操作,GPT-6-Astra 也只能解决其中 60%。用这些合成数据训练的两个不同尺寸 Qwen 模型,在 8 个分布外基准上均取得明显提升。代码已在 GitHub 开源。
Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
Agent learning is shifting from learning from human data toward learning through interaction with the world. However, scaling such learning directly in real-world computer systems is challenging and can introduce substantial security risks. We therefore propose Agent World Model in the Wild (WildAWM), a scalable pipeline for synthesizing controllable environments and tasks for training general computer-use agents (CUAs). Whereas existing approaches typically specialize in a single agent interaction interface, we construct executable environments that jointly support graphical user interfaces, model context protocol services, and command-line interfaces, allowing agents to flexibly combine visual interaction, tool use, and code execution. WildAWM is entirely powered by open-source models, demonstrating that high-quality computer-use environments can be generated without proprietary frontier models. Beyond environments, we address three recurring challenges in task synthesis: ensuring solvability, maintaining sufficient difficulty, and producing reliable verifiers, by introducing execution-based quality gates that combine heterogeneous agent rollouts, cross-judge consistency checks, and counterfactual probes of judgment robustness. The resulting pipeline synthesizes 341 long-horizon environment-task pairs that can require over 100 agent steps to solve and remain challenging even for frontier models, with GPT-6-Astra solving only 60% of them. We train two Qwen models of different sizes exclusively in these synthetic worlds. Both models achieve substantial gains across 8 out-of-distribution benchmarks spanning web, claw, and computer-use agents, demonstrating that learning in WildAWM's synthesized worlds generalizes broadly to unseen computer-use tasks. The code is publicly available at https://github.com/MSR-Orchard/WildAWM.