论文

Dual-Frontier:智能体何时能信任自己的世界模型

Dual-Frontier: When Can an Agent Trust Its World Model?

精选理由

一篇偏理论但很实用的论文:教智能体判断啥时候该信自己的世界模型,不确定就先验证,工具使用基准上确实更稳了。

arXiv 论文将世界模型引导决策的失败归因问题形式化为回报损失的因果分解,并证明仅靠被动交互数据无法识别失败是决策规则还是世界模型造成的。作者提出 Dual-Frontier 学习原则:只有当预测优势超过决策相关世界模型误差的认证界限时,才采纳该决策,否则将证据分配给世界模型验证。论文给出了动作条件价值界限和闭环扩展,保证被采纳决策的回报不减,并通过校准门控与同时置信序列实现自适应证据复用。实验部分在可控学习模型场景中验证了预测的失败模式,并在跨骨干的工具使用基准上以验证后提升的规则改善决策质量。

原文 · arXiv cs.AI

Dual-Frontier: When Can an Agent Trust Its World Model?

Learned world models are becoming essential to general-purpose agents: by predicting action consequences, they support planning and decision-making while reducing reliance on costly trial and error. This reliance creates a fundamental ambiguity: when a world-model-guided decision fails, the trajectory alone may not reveal whether the agent's decision rule or the world model caused the loss. We formalize this failure-attribution problem as a counterfactual decomposition of return loss and prove that its components are not identifiable from passive interaction, even for finite-horizon planners. This obstruction motivates Dual-Frontier, a learning principle that admits a world-model-guided decision only when its predicted advantage exceeds a certified bound on decision-relevant world-model error; otherwise, evidence is allocated to world-model verification. Action-conditioned value bounds and a closed-loop extension guarantee non-decreasing return for admitted decisions. Calibrated gates and simultaneous confidence sequences support adaptive evidence reuse, with sufficient and necessary verification bounds. Controlled learned-model experiments validate the predicted failure modes and certification behavior, while cross-backbone tool-use benchmarks instantiate the same verify-then-promote rule in realistic agent world-model pipelines, consistently improving decision quality and reliability.