模型76°

Google 发布首个决策模型 Gemini Decision 1,Decision Index 得分 66

精选理由

Google 第一次做决策模型,知识推理类基准领先,但做文档分类抽取时准确率明显不如 Drex Max v1.1,价格还是人家的三倍多。如果你在选决策类模型做路由或抽取,这份基准数据直接帮你算清性价比,采购前值得对照看。

Google DeepMind 发布首个决策模型 Gemini Decision 1,在 Artificial Analysis Decision Index v2.1 上得分 66,落后榜首 Drex Max v1.1 和 GLiDE v1.2(均为 73 分)7 分,与 Elephant 9B、Jev 1.14 持平。

正文

能力分布不均:知识类基准表现领先,AA-Omniscience-Decision 得 66 分,HLE-MultiChoice 得 49 分;但在分类与抽取基准 AA-Paperclip 上,全 15 题答对的文档比例仅 33%,明显低于 Drex Max v1.1 的 63%。校准方面整体 Brier 分数 0.18,处于 Drex Max v1.1(0.16)与 Jev 1.14(0.19)之间,其中 HLE-MultiChoice 上 0.20 属全场最低之一,When2Call 上 0.14 则远逊于 Drex Max v1.1 的 0.04。

成本是明显短板:输入 token 定价 $0.10/1M,是 Drex Max v1.1($0.03)的三倍多,折算每 100 万 Tasks 成本 $345,与 GPT-6 Luna($339)接近,而 Drex Max v1.1 仅 $103。

原文 · Artificial Analysis

Google has released its first decision model, Gemini Decision 1, scoring 66 on the Artificial Analysis Decision Index and leading in knowledge and reasoning benchmarks

Gemini Decision 1 from @GoogleDeepMind scores 66 on the Artificial Analysis Decision Index v2.1, in line with Elephant 9B (@baselabs) and Jev 1.14 (@typesafeai), and 7 points behind leaders Drex Max v1.1 (@NaceAI) and GLiDE v1.2 (@fastinoAI), which both score 73. It is priced at $0.10 per 1M input tokens and costs $345 per 1M Tasks across the Index, around three times higher than Drex Max v1.1 ($103) due to its higher pricing

Key results for Gemini Decision 1:

➤ Not yet frontier on Decision Index: Gemini Decision 1 scores 66 on the Artificial Analysis Decision Index. It leads knowledge and reasoning benchmarks, scoring 66 on AA-Omniscience-Decision and 49 on HLE-MultiChoice. It trails on other evaluations, including our new proprietary classification and extraction benchmark AA-Paperclip, where it answers all 15 questions correctly on 33% of documents vs. 63% for Drex Max v1.1

➤ More than 3x the Cost per Task of leading models: Gemini Decision 1 costs $345 per 1M Tasks, compared with $103 for Drex Max v1.1, $156 for Jev 1.14. This difference is driven by its token price of $0.10 per 1M input tokens vs. $0.03 for Drex Max v1.1. Gemini Decision 1 has a similar Cost per 1M Tasks to GPT-6 Luna (Decisions, $339)

➤ Strong calibration for reasoning tasks: We measure calibration with the Brier score, the average squared gap between the probability a model assigns to its chosen answer and whether that answer was correct (lower is better). Gemini Decision 1 has a Brier score of 0.18 across the Index, between Drex Max v1.1 (0.16) and Jev 1.14 (0.19). Calibration varies by task. with its Brier score of 0.20 on HLE-MultiChoice among the lowest of all models in the Index, while its 0.14 on When2Call compares with 0.04 for Drex Max v1.1

产业坐标与信源核验

本条情报归属 AITOP「模型」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「中美大模型技术代差与商业化对照」「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Gemini Decision 1、Google DeepMind、Artificial Analysis、Drex Max,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「Artificial Analysis」(@ArtificialAnlys),经 AITOP 多维评分管线结构化提炼。