模型精选

Liquid AI 发布 d1-ultra,登顶 Artificial Analysis Decision Index v1.0

精选理由

Liquid AI 新出的 d1-ultra 拿了决策模型榜第一,幻觉率从 2% 干到 85%,价格只有 GPT-6 Luna 一半,做自动化决策的可以看看。

Liquid AI 发布决策模型 d1-ultra,在 Artificial Analysis Decision Index v1.0 上以 65 分排名第一,超过 Jev 1.14 的 57 分。它的非幻觉率达 85%,而月初发布的 d1 仅为 2%,代价是准确率从 41% 降到 32%。单任务耗时 92 毫秒,在所测决策模型中排第三。定价为每 100 万任务 32 美元,约为 GPT-6 Luna (Decisions) 79 美元的一半。

原文 · Artificial Analysis

Liquid AI has released d1-ultra, taking the #1 position on the Artificial Analysis Decision Index v1.0, supported by a reduction in hallucinations

d1-ultra is the new decision model from @liquidai and follows on from their release of d1 earlier this month. It is priced at $0.042 per 1M input tokens compared to $0.02 per 1M input tokens for d1. Like d1, d1-ultra is billed only on input tokens.

Key takeaways:

➤ d1-ultra leads the Artificial Analysis Decision Index v1.0 with a score of 65: d1-ultra scores 65, ahead of the recently released Jev 1.14 at 57 and GLiDE and Microsoft-Decision-1 at 54

➤ d1-ultra’s score of 65 is driven by a much lower hallucination rate on AA-Omniscience-Decision: d1-ultra’s non-hallucination rate on AA-Omniscience-Decision is 85%, up substantially compared to d1 at 2%. The non-hallucination rate is the share of questions not answered correctly where the model chose "I don't know" and measures how well a decision model can judge its own knowledge in knowing when not to answer. While d1-ultra’s hallucination rate decreases, so does its accuracy (% questions correct). It achieves an accuracy of 32%, down 9 points compared to d1 (41%)

➤ d1-ultra has the third lowest Time per Task of any decision model: d1-ultra achieves a Time per Task of 92 ms, the third lowest of decision models measured, behind Jev 1.14 at 78 ms per task and Celeris-1 Decision at 63 ms per task

➤ d1-ultra offers comparable pricing to other decision models at $32 per 1M tasks: At $32 per 1M tasks, d1-ultra is comparably priced to Celeris-1 Decision ($32 per 1M tasks) and Microsoft-Decision-1 ($31 per 1M tasks), more than double the price of d1 and Mercury Decide at $15 per 1M tasks but less than half the price of GPT-6 Luna (Decisions) at $79 per 1M tasks