模型

SemiAnalysis 推出 GDPx 基准,AI 智能体得分均未超过 12%

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

精选理由

SemiAnalysis 搞了个新基准 GDPx,模拟芯片设计、量化交易这类真实工作,结果最强的 Claude Opus 5.5 也才 12% 出头,智能体离真干活还差得远。

研究机构 SemiAnalysis 发布 GDPx 基准,用模拟知识工作测试 AI 智能体,任务覆盖芯片设计、量化交易等场景。测试中没有任何模型的得分突破 12%,其中 Claude Opus 5.5 以微弱优势领先 Gemini 4 Carbon。有批评者指出,该基准每个领域的任务数量偏少,且测试条件不一致,结果可能不够可靠。

原文 · Decoder

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

SemiAnalysis is putting AI agents through simulated knowledge work in its new GDPx benchmark, covering everything from chip design to quant trading. No model breaks 12 percent. Claude Opus 5.5 leads narrowly over Gemini 4 Carbon. Critics point to the small number of tasks per domain and uneven testing conditions. The article No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark appeared first on The Decoder .