模型精选

AA-PersonalityBench:开源模型真话维度平均落后闭源32分

精选理由

Artificial Analysis 拿 10 个开源和 10 个闭源模型比性格特征,开源在真实度上平均低 32 分,但在一句话总结和简洁度上反而占优,做模型选型可以参考。

Artificial Analysis 用 AA-PersonalityBench 对 Intelligence Index 得分最高的 10 个开源权重模型和 10 个闭源模型做了 30 项性格特征百分位对比。开源模型在 Truthful 上平均分 47,闭源为 79,差距 32 分,是所有特征里最大的。开源模型在 Pragmatic(49 vs 79)、Structured(45 vs 73)、Evidence-Based(47 vs 76)等维度也普遍偏低。开源模型得分更高的特征是 Slop(49 vs 30)、Bottom-Line Summary(62 vs 47)和 Scannable(53 vs 41)。

原文 · Artificial Analysis

In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher on slop and summarizing the bottom line

We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores. Each model is percentile ranked from 1 to 100 on each of 30 personality traits. On average, the top open weights models rank 32 points lower than the top proprietary models on Truthful, the largest gap of any trait.

Average rank, top proprietary vs. top open weights:

➤ Open weights rank lower: Truthful (79 vs. 47), Pragmatic (79 vs. 49), Natural Sounding (77 vs. 52), Evidence-Based (76 vs. 47), Structured (73 vs. 45) and Literate (70 vs. 47)

➤ Open weights rank higher: Slop (30 vs. 49), Bottom-Line Summary (47 vs. 62) and Scannable (41 vs. 53)