论文

智能体元推理提升长任务性能

Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning

精选理由

元推理方法让AI智能体在长任务中表现更好,GPT-5.5和Opus 4.8都超过了竞争对手。

研究团队提出智能体元推理方法,在ProgramBench基准测试中,GPT-5.5实现71.5%准确率,超越Codex的58.0%;Opus 4.8达到67.2%,优于Claude Code的65.5%。在多个基准测试中,该方法比直接控制平均提升3.6-4.2个百分点。元推理方法在预算范围内持续改进,而直接控制则趋于平稳。

原文 · arXiv cs.AI

Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning

As agents take on longer and more complex problems, controlling the execution becomes a task in its own right. Each step in the run brings new control choices, like which partial work to build on, whether to start fresh, or when to stop. We introduce agentic meta-reasoning, an inference-time harness that makes these choices an explicit and structured reasoning process. Workers carry out the task-level computation, while a controller consolidates what the run has established, explores next options, assesses what each option is worth under the remaining budget, and dispatches the chosen work with context drawn from persistent memory. Between decisions the controller carries only a compact account of the run rather than replaying its full history. Our baselines span production coding agents and research harnesses, together with a Direct Control Agent using the same workers and compute budget allowance. On ProgramBench, which tests long-horizon agentic capability through program reconstruction, meta-reasoning achieves 71.5% with GPT-5.5 against 58.0% for Codex; with Opus 4.8 it achieves 67.2% against 65.5% for Claude Code. On the other benchmarks, spanning abstract reasoning, multi-domain long-horizon reasoning, and proof generation, it gains between 3.6 and 4.2 points over direct control, averaged across three frontier models. It keeps improving over the tested budget ranges where direct control plateaus, though its overhead can hurt at small budgets. Artifact-graph analysis reveals more reuse of earlier work, higher coverage of correct solutions in most settings, and nonuniform gains in final selection. These results indicate that spending computation on structured control becomes more important as agents scale to longer runs.