Scientist World:把 1000 篇论文变成 AI 科研可执行环境
Scientist World: Grow a Research World for AI-Scientists
把 1000 篇论文做成 AI 科学家能跑的实验环境,还测出它在 74% 场景下跑赢人类作者,训练数据也开源了,做科研智能体的别错过。
Scientist World 将每篇研究论文转换为一个可执行环境,自动抽取论文的开放研究问题,并把原方法复现为 baseline。项目首批发布 1000 个经过验证的环境,AI-Scientist 进入环境后需与人类作者取得的成绩对比评估。测试显示前沿 AI-Scientist 在 74% 的环境中超过人类研究者的结果。项目还包含 6400 小时的完整科研轨迹记录,涵盖想法、实验、失败与成功;用这些数据训练可将小模型的研究构思能力提升 158%,达到前沿模型水平。
Scientist World: Grow a Research World for AI-Scientists
AI-Scientists arrived, but a world for them to grow in did not. Human scientists take theirs for granted $-$ centuries of open problems and shared ideas, waiting in the scientific literature. To AI-Scientists, that world is readable but not runnable, so we build Scientist World for them: every research paper becomes an executable environment. Our autonomous pipeline extracts each paper's open-ended research question and reproduces its proposed method as the baseline; an AI-Scientist entering the environment is evaluated against what the human authors achieved. We release the first 1,000 verified environments. With the world as an evaluation, we found that frontier AI-Scientists can already surpass the human researchers 74% of the time. As a record of how AI does science, it contains 6,400 hours of research traces, with every idea, experiment, failure, and success. As a training ground, we are able to raise (+158%) a small model to match frontier models in research ideation. At last, AI-Scientists' own world has arrived, grown from and growing with science itself.