论文精选

RSI-Craft 论文探索让模型自主完成 LLM 后训练

精选理由

一篇关于递归自我改进的论文:他们把论文变成可执行训练环境,微调后的 Qwen 35B 在 PostTrainBench 上追平了 GLM-5.2。

论文团队构建了 RSI-Craft 流水线,将研究论文转化为可执行的训练环境,包含数据集、指标和评测代码。经过可靠性和难度过滤后保留 281 个后训练任务,前沿模型在改进的 harness 下解决这些任务。过滤后的轨迹用于微调 Qwen 模型,9B 版本提升 8.74 分。RSI-Dojo-35B-A3B 在 PostTrainBench 上提升 16.87 分,达到 29.95,接近 GLM-5.2 和 GPT 5.5 的水平。

原文 · DAIR.AI

Great new paper on recursive self-improvement.

Self-improving AI is one of the most discussed ideas right now. This paper explores training a model to run LLM post-training itself.

(bookmark it)

The team built RSI-Craft, a pipeline that turns research papers into executable training environments, including datasets, metrics, and evaluation code. After filtering for reliability and difficulty, 281 post-training tasks remain. Frontier models solved them under an improved harness, and the filtered trajectories were used to fine-tune Qwen models. The 9B version gains 8.74 points.

RSI-Dojo-35B-A3B gains 16.87 points on PostTrainBench and reaches 29.95, similar to GLM-5.2 and GPT 5.5.

https://t.co/wOTXJwHPzm

Chat with Paper: https://t.co/oKjJdi8r40