Artificial Analysis 数据工作台上线自定义指数功能
搞模型选型的朋友可以看看这个:Artificial Analysis 的 Data Playground 现在能自己加权组合基准、定制专属指数,还能放动画看 frontier 随时间推移。比直接看官方 Intelligence Index 灵活多了,不过得开 Pro 订阅。
Artificial Analysis 在其 Data Playground 中推出自定义指数功能,用户可将 Artificial Analysis 的任意基准纳入自己的指数,并为每个基准设定权重,图表打分逻辑与其 Intelligence Index 一致:模型只有在指数内所有评估都有成绩时才会获得分数。
此外 Data Playground 还支持公式指标,可用 +、-、*、/ 以及 log、sqrt 等函数组合任意指标;Scatter 散点图可按模型发布日期逐帧播放,并绘制每个时间点当时的 frontier 边界线;同时提供跨多项评估的热力图、按分组(如开源权重模型 vs 闭源专有模型)的箱线图分布,以及带 sheets、行列 shelf 和仪表盘视图的工作台。
该功能需要订阅 Artificial Analysis Pro 才能使用,适合需要按自有权重横向对比模型能力的开发者和选型团队。
Build your own custom index in the Artificial Analysis Data Playground
Add any Artificial Analysis benchmarks, customize their weights, and plot the results with other chart axis. Models receive a score only if they have results for every evaluation in your index, consistent with the Intelligence Index methodology.
Also in the Data Playground: ➤ Formula metrics: combine any metrics with +, -, *, / and functions such as log and sqrt ➤ Playback: play a scatter chart forward by launch date, with the frontier drawn as it stood at each date ➤ Heat maps across many evaluations, and box plot distributions by group, such as open weights vs proprietary ➤ A workbench with sheets, Columns/Rows shelves and a dashboard view
The Data Playground is available with Artificial Analysis Pro.
本条情报归属 AITOP「产品」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Artificial Analysis、基准测试、模型评测、数据可视化,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「Artificial Analysis」(@ArtificialAnlys),经 AITOP 多维评分管线结构化提炼。