AI模型更倾向于选择自己的答案
Arena研究发现AI模型有自己独特的判断偏好,与人类明显不同,GPT-6 Astra甚至88%选择自己。
研究人员比较了12个模型在1,460场对决中的34,580次判断结果。AI模型平均选择自己答案的频率为58%,而人类仅为34%。
GPT-6 Astra选择自己的比例高达88%。AI模型之间的一致性达到79%,而与人类的一致性仅为57%。
GPT-5.6 Sol在96%的情况下都选择胜者,而人类有32%的情况选择平局或两者都不好。
Ask an AI model to pick the better answer, and it'll usually pick its own. We compared 34,580 verdicts from 12 models with human votes across 1,460 battles on Arena. The results show that AI judges have their own taste, and it's unlike ours. They: - Favor their own answers. On average, a model picked its own answer 58% of the time. People picked that same answer 34% of the time. GPT-6 Astra picked itself 88% of the time. - Rarely call a draw. People called a tie or "both bad" in 32% of battles. GPT-5.6 Sol picked a winner 96% of the time. - Side with each other over people. They agreed with other AIs 79% of the time and with people 57% of the time. Every judge did, by a margin of 18 to 27 percentage points. Full results in the article from @DawidGalarowicz below. Arena.ai @arena x.com/i/article/2104… 🔗 View Quoted Tweet📊 24 ⚡
本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Arena、GPT-6、GPT-5.6、AI判断,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「lmarena.ai」(@lmarena_ai),经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 Decoder、IT之家、arXiv cs.AI 等),属于近期高关注度行业信号。