PatternBloom 让 Agentic RAG 学会可复用的推理图模式
PatternBloom: Empowering Agentic RAG with Externalized RL-Distilled Graph Patterns
搞 RAG 智能体的值得看看:它不再只检索文本,而是把 RL 训练出的推理骨架存成图谱记忆给 agent 复用。7B 模型跑赢了 27 个基线 15 个点,代码也开源了,想做深度推理检索的团队可以直接抄作业。
PatternBloom 是一个新的 agentic RAG 框架,把检索单位从“读什么内容”转向“怎么推理”。方法分两阶段:第一段 RL 用冻结 oracle 的信息增益(Information-Density Reward,即尺寸归一化的互信息代理指标)给 agent 构建的证据图打分;高奖励轨迹被蒸馏成类型抽象的推理骨架库 Graph Pattern Memory(GPM)。
第二段 RL 引入 Pattern-Augmented Reward(PAR)把策略与 GPM 耦合,使过程性推理变成可外置、可复用的结构先验,而不是每次查询都重新推导。作者实验显示 7B 模型的 PatternBloom 在 27 个基线方法上平均超出 +15.0 Avg-OOD EM,且增益随推理深度增加而扩大,因为过程性知识被蒸馏后可跨查询复用。代码已在 GitHub 开源,对做 RAG 和智能体 RL 训练的团队有直接参考价值。
PatternBloom: Empowering Agentic RAG with Externalized RL-Distilled Graph Patterns
Reinforcement-learning-trained agents for retrieval-augmented generation retrieve content (passages, knowledge-graph fragments, or hyperedges) and supervise training with outcome rewards on the final answer. Across these paradigms the reasoning route through retrieved content never leaves the language model's hidden state, conflating declarative knowledge with the procedural knowledge that recurs across queries of the same logical type; content-only methods consequently plateau as reasoning depth grows. We introduce PatternBloom, an agentic RAG framework that shifts the unit of retrieval from content (what to read) to logic (how to reason). A first RL stage scores the agent's constructed evidence graph by a frozen oracle's information gain through the Information-Density Reward (IDR), a size-normalized mutual-information surrogate. High-reward trajectories are distilled into a Graph Pattern Memory (GPM) of type-abstracted reasoning skeletons, and a second RL stage uses the Pattern-Augmented Reward (PAR) to couple policy to memory, turning procedural reasoning into a learnable, externalized structural prior. A 7B PatternBloom outperforms $27$ baselines by $+15.0$ Avg-OOD EM, with the gain compounding with reasoning depth precisely because procedural knowledge, once distilled, is reused rather than re-derived at every query. We release our code at https://github.com/EllenYiGe/PatternBloom.
本条情报归属 AITOP「模型」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」「中美大模型技术代差与商业化对照」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:PatternBloom、Agentic RAG、强化学习、RAG,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「arXiv cs.AI」(@Yi Ge, Heng Huang),经 AITOP 多维评分管线结构化提炼。