CritPt v2 登陆 Artificial Analysis：研究级物理基准全面修订
研究级物理基准 CritPt 出 v2 了，题目全改过，模型还能跑代码作答。看看 GPT-6 和 GPT-5 差了 54 分，前沿进展挺直观的。
Artificial Analysis 上线 CritPt v2，对 70 道研究级物理挑战全部修订，修正了表述不清、错误和笔误，并改进了评分器稳定性。模型现在以智能体方式作答，可在离线沙盒中编写并运行代码。榜单上 GPT-6 Astra (max) 以 83% 居首，GPT-6.1 Sol (max) 得 82%，Claude Opus 5.5 得 78%。GPT-5 (high) 在 CritPt v2 上仅得 29%，与 GPT-6 Astra 相差 54 个百分点。Intelligence Index 将于 10 月底更新并纳入 CritPt v2。
CritPt v2 has launched on Artificial Analysis: the CritPt authors have revised all 70 research-level physics challenges, and models now solve them with a code-execution tool
Following feedback from the research community, the CritPt team and physics expert collaborators reviewed every challenge, corrected underspecified statements, errors, and typos, and improved the stability of the grader. We now run CritPt v2 agentically: models can write and run code in an offline sandbox with tools for computation.
We’ll be updating the Intelligence Index in late October, including changes to CritPt.
Key takeaways:
➤ Recent OpenAI releases top the leaderboard: GPT-6 Astra (max) and GPT-6.1 Sol (max) score highest at 83% and 82%, followed by Claude Opus 5.5 (max with fallback) at 78% and GPT-5.6 Sol (max) at 75%
➤ CritPt v2 shows the rapid progress at the frontier on research-level physics: GPT-5 (high), released in August 2025, scores 29% on CritPt v2, 54 points below GPT-6 Astra (max)
Thank you to @MiniHui_zhu, @MinyangTian1, @haopeng_uiuc and the broader CritPt team for their work on this revision and their continued collaboration
