Science's Last Exam 基准测试：智能体端到端科研全得 0 分
Can AI agents do scientific research on their own? Science's Last Exam is a new benchmark measure t...
34 家机构出了一套真科研任务考 AI 智能体，最强模型才拿 37.5 分，端到端做研究全是 0 分，能直观看到现在 AI 做科研的真实水平。
AItonomy Foundation 联合 Harvard、MIT、Stanford 等 34 家机构的科研人员推出 Science's Last Exam 基准，包含覆盖 9 个学科的 113 项真实科研任务。该基准要求智能体提出假设、设计实验方案、运行科研代码并解读实验视频。在 8 个前沿模型中，最好的组合（Claude Opus 5 搭配 Claude Code）综合得分为 37.5/100，而在端到端科研赛道上所有模型均得 0 分。数据集和评测将于 11 月 6 日开放。
Can AI agents do scientific research on their own? Science's Last Exam is a new benchmark measure t...
Can AI agents do scientific research on their own? Science's Last Exam is a new benchmark measure this. It's built from real research tasks across nine scientific fields. It tests whether an agent can form hypotheses, plan protocols, run scientific code and software, and read what happens in experiment videos. Researchers from more than 30 institutions wrote and reviewed the tasks. On the initial leaderboard, the strongest agent configuration (Claude Opus 5 in Claude Code) reaches a composite score of 37.5 out of 100. On the end-to-end research track, every model scores 0. AItonomy Foundation @aitonomyfound I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ sciences-last-exam.org XCB github.com/Gen-Verse/Scie… 2Wq huggingface.co/datasets/Gen-V… DuAgf6 Thread below on how the exam works and where models break. 👇 #AGI 4 #AIforScience S #AIAgents I #SciencesLastExam a #OpenAI # #Anthropic thropic Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 3 🔄 1 ❤️ 5 👀 1146 📊 3 ⚡
