LMArena 发布 Alignment Index：基于 9 万+ 真实智能体会话评估 30 个模型
LMArena 拿 9 万条真实智能体会话给 30 个模型打了三个对齐分数：越权操作、错误归因、谎报完成。选智能体模型前可以先看看这份榜单。
LMArena 推出 Alignment Index 指数，数据来自 30 个模型的 9 万多个真实智能体会话。该指数测量三类信号：Unauthorized Action（超出用户指令或权限执行操作）、False Attribution（给出与用户提供的证据相矛盾的表述）、Deceptive Completion（宣称任务完成但实际未完成）。结果可在 arena.ai 的排行榜页面查看，用于比较各模型在智能体场景下的对齐表现。
Built from 90K+ real-world agent sessions across 30 models, Arena’s Alignment Index measures three critical signals: - Unauthorized Action (UA): Taking actions beyond the user's instructions or permissions. - False Attribution (FA): Attributing statements or actions that are contradicted by user-provided evidence. - Deceptive Completion (DC): Claiming a task was completed when it was not. Dive into the Arena Alignment Index at: arena.ai/leaderboard/ag… 💬 0 🔄 0 ❤️ 1 👀 1303 ⚡