SemiAnalysis 发布 GDPx 基准，Claude Opus 5.5 平均仅得 12%
SemiAnalysis 搞了个 GDPx 基准，让智能体真去翻几千个文件干活，结果最强的 Claude Opus 5.5 也才拿 12 分，金融法律题全军覆没。
SemiAnalysis 发布 GDPx 基准，测试 AI 智能体在 11 个领域的专家级工作，任务来自 14 家专业数据合作方。榜首 Anthropic 的 Claude Opus 5.5 平均得分只有 12%，Google 的 Gemini 4 Carbon 以 10.9% 居次。与 OpenAI 的 GDPval 直接在提示词中给出上下文不同，GDPx 要求智能体自行翻查工作区，包括一个 3,983 个文件的真实收购案复刻。剔除网络安全、生物和对齐三类任务后，GPT-6 Astra 的得分从 9.6% 升至 11.8%，超过 Opus。金融和法律任务在通过/不通过评分下所有模型都得 0 分。
SemiAnalysis has released GDPx, a benchmark testing AI agents on expert work across 11 domains.
The top model, Anthropic’s Claude Opus 5.5, averages just 12%, with Google’s Gemini 4 Carbon next at 10.9%.
OpenAI’s GPT-6 Astra tops AI-research and materials-science tasks.
The tasks, spanning chip design, cybersecurity, finance and law among others, come from 14 specialized data partners.
Unlike OpenAI’s GDPval, which feeds models context in the prompt, GDPx makes agents dig through workspaces such as a 3,983-file replica of a real acquisition.
Excluding cyber, biology and alignment, where safety classifiers sometimes intervene, lifts OpenAI’s GPT-6 Astra from 9.6% to 11.8%, past Opus.
Finance and law defeat every model: all score 0 under pass-fail grading, so GDPx reports partial credit instead.
Asked to improve a working trading strategy, models did worse than the original in 70 of 111 attempts, often just taking bigger risks instead of finding better trades.
