IFM 开源世界模型 PAN 2,用模拟式推理让智能体先演练再行动
IFM 把世界模型做成了智能体的"预演器":29B 的 LDM 负责画后果,LLM 负责想后果,选最优再动手。和纯文本推理的 agent 框架相比,它多了视频级的可视化验证。做机器人、游戏或决策型智能体的开发者可以直接下载权重和代码上手试。
Institute of Foundation Models(IFM)发布了世界模型 PAN 2,并提出"模拟式推理"(simulative reasoning)的思路:让智能体在执行前先模拟每个候选动作的后果,再选出最优方案。
视频示例中,模型对同一道浪的三个不同起乘时机分别推演,只有其中一个能成功追上浪,智能体因此选择该方案。技术上,PAN 2 采用 Generative Latent Prediction(GLP):输入当前场景、动作和模拟时长,输出一段可供核查的视频。
推理分为两部分,由 LLM 承担概念推理,负责推演接下来会发生什么;再由一个 29B 参数的 LDM 承担感知推理,补全画面细节。
项目以 Apache 2.0 协议开源,权重、训练代码和推理代码全部公开,开发者可以直接运行并在其上构建。
This is a pretty cool idea:
Let your agent simulate each potential action before picking the best one.
The model is PAN 2, a world model from the Institute of Foundation Models (IFM). They call this "simulative reasoning".
The attached video shows an example with a surfer: same wave, three different moments to pop up. PAN 2 plays out all three, and only one of them catches the wave, so that’s the one he goes with.
The model uses Generative Latent Prediction (GLP), and here is how it works:
• In: the current scene plus an action, with how long to simulate
• Out: what happens next, as a video you can check
There are two reasoning parts:
1. Conceptual reasoning: The LLM is the backbone here. It reasons about what happens next.
2. Perceptual reasoning: A 29B LDM fills in what it looks like.
This is all open under Apache 2.0!
They provided the weights, training code, and inference code, so you can run it and build on it yourself.
本条情报归属 AITOP「模型」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」「中美大模型技术代差与商业化对照」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:PAN 2、IFM、世界模型、开源模型,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「Ate-a-Pi」(@svpino),经 AITOP 多维评分管线结构化提炼。