Artificial Analysis 发布 AA-3D 基准：21 个模型盲测比拼 3D 场景搭建
AA-3D 让模型直接在沙盒里搭 three.js 3D 场景，再由千人评审盲测打分，Claude 系和 GPT-6 Astra 并列头部，开源模型落后 200 多分。
Artificial Analysis 推出 AA-3D 基准，让模型作为智能体在离线沙盒中把 55 份文字简报变成 three.js 交互 3D 网页，沙盒配备 Blender、Rapier 物理引擎和无头浏览器。超过 1000 名评审投出 10000+ 票，用 Elo 排名 21 个模型。Claude Sonnet 5.5（1194）、Claude Opus 5.5（1190）、GPT-6 Astra（1165）和 Claude Fable 5.1（1131）四个模型在统计上并列第一。开源模型最好成绩是 Kimi K3（982），排名第 11，落后第一名超过 200 分。单个场景成本从 0.20 美元到 32.08 美元不等，最便宜的 GPT-6 Luna 排名第八。
We have measured intelligence. Now it's time to see it.
We are launching AA-3D, our new benchmark for how well AI models build interactive 3D scenes. Each model works as an agent in an offline sandbox and turns a written brief into a three.js web page. A human panel of judges compares pairs of scenes built from the same brief without knowing which model made which.
AA-3D details:
➤ 55 written briefs across seven domains, including landmarks, machines, living bodies, games, and space. Each brief says what the scene must show and how people should interact with it, and leaves the rest to the model
➤ Each model gets up to three hours and 250 turns. Its sandbox has Blender, Rapier physics, Python, a headless browser to test its own work, and a CC0 library of materials, 3D models, and characters
➤ Panelists spend at least 30 seconds with each scene before they vote. One comparison in every four is a validation check
➤ Over 10,000 counted votes from over 1,000 panelists rank 21 models by Elo, with 95% confidence intervals
Key findings:
➤ Four models are statistically tied at the top: Claude Sonnet 5.5 (1194), Claude Opus 5.5 (1190), GPT-6 Astra (1165), and Claude Fable 5.1 (1131). The 95% confidence intervals of the other three overlap Claude Sonnet 5.5's
➤ AA-3D Elo rises with intelligence: each point on the Artificial Analysis Intelligence Index is worth about 18 Elo (Pearson 0.92)
➤ The best-placed open weights models, Kimi K3 (982) and MiMo-V2.6-Pro (977), rank 11th and 12th, more than 200 points behind first place
➤ A scene costs $0.20 to $32.08, depending on the model. The cheapest, GPT-6 Luna, ranks eighth
More results, more scenes, and how AA-3D works follow in the thread below.
