研究测试向 Qwen3.8-Flash 与 DeepSeek-V4.1 记忆模块写入知识的可行性
Writability and the Pathway: A Controlled Study of Knowledge Injection into Addressed Memory
把知识写进模型记忆到底行不行?这篇论文在 Qwen 和 DeepSeek 上做了实测,命中率数据挺扎眼,做记忆机制研究的值得看数据。
一项受控研究用 GPT-2 的 2x2 实验设计比较了向寻址记忆模块注入知识的不同写法,自然问题命中率从 row-only 的 5.3% 提升到无锚定投影更新的 28.7%。在生产记忆实验中,梯度写入让 Qwen3.8-Flash-Next-FP8 上 132 个独立重置目标的首答案 token 排到第一,其中 93 个为新提升。Adam 优化器在 24 目标对比中带来 13 个新提升,SPSA 只有 2 个。DeepSeek-V4.1-Flash 的 6 个零阶写入案例产生 1 次提升和 1 次回退,说明写入能力存在边界。
Writability and the Pathway: A Controlled Study of Knowledge Injection into Addressed Memory
Addressed conditional memory provides a local surface for post-hoc knowledge injection, but a successful write need not transfer to a new question or preserve untargeted behavior. This study combines a controlled GPT-2 comparison with production-memory experiments on Qwen3.8-Flash-Next-FP8 and DeepSeek-V4.1-Flash. Newly initialized modules attached to frozen GPT-2 are tested in a 2 x 2 design: row-only versus row-plus-projection updates, each with or without fixed module-residual anchoring. All arms reproduce 50 trained completions in each of three sampling seeds. Natural-question target-string hits average 5.3% for both row-only arms, 28.7% for unanchored projection updates, and 22.0% with anchoring, while strict answer scores remain zero. Anchoring lowers measured drift; lexical hits do not establish entity-specific retrieval. In the archived Qwen experiments, gradient writes make the designated first answer token top-ranked for 132 independently reset targets, comprising 93 new promotions and 39 already top-ranked targets. A separate matched 24-target comparison gives 13 new promotions with Adam versus two with SPSA at equal iteration counts but unequal computational procedures. An 80-row case includes saved continuations and a replay record, while reformulations bound its scope. Six DeepSeek zero-order cases yield one new target-token promotion and one regression. These results support bounded writing feasibility and separate trained expression, question-form behavior, and preservation; first-token rankings do not establish complete-answer success or universal conditions for writable memory.