TasteVal基准出炉:Claude Opus 5.5科研品味达专家2.3倍
新出了个测"科研品味"的基准,Claude Opus 5.5已到专家2.3倍,成本只要1/30。
P-Zero Research推出TasteVal基准,用8个真实AI研发任务考察模型设计实验和解读结果的能力,按所需算力与人类专家对比计分。从2023年的GPT-4到2025年得分增长缓慢,2025年12月以来分数每3.0个月翻一番。Claude Opus 5.5目前达到专家基线的2.30倍,领先Fable 5.1和GPT-6 Astra,单次尝试成本约为专家的1/30。Jack Clark据此预计AI在2027年可能开始改进AI自身。
P-Zero Research's new TasteVal benchmark measures research taste: how well a model designs experiments and reads their results on eight real AI-development tasks, scored by how much compute it needs compared with human experts (the dashed 1x line).
Progress was slow from GPT-4 in 2023 through 2025, then the slope steepened: since December 2025, scores have doubled every 3.0 months. Claude Opus 5.5 now sits at 2.30x the expert baseline, ahead of Fable 5.1 and GPT-6 Astra, at roughly 1/30 of the experts' cost per attempt.
Research taste is the skill that decides how quickly AI could start improving AI, and this curve is one reason Jack Clark now expects that in 2027 (wrote about that yesterday as well).