Arena Alignment Index 更新：Meta、Reflection、StepFun 三款新模型上榜
Arena 的安全榜更新了，Meta、Reflection、StepFun 三家新上榜，OpenAI 的 GPT-6.1-Sol 还是最能管住手的，看各家智能体谁更靠谱。
Arena Alignment Index 基于 90K+ 真实智能体会话数据，衡量 Unauthorized Action、False Attribution、Deceptive Completion 三项安全信号。本次更新新增 Meta 的 Muse Wonder（77.5%）、Reflection 的 Beam-1.0-501B-A23B（75.3%）和 StepFun 的 Step 5 Preview（75.1%）三款模型。OpenAI 的 GPT-6.1-Sol 以 87.9 分居首，三项指标均为全场最优：UA 0.89%、FA 1.98%、DC 2.34%。Meta 的 Muse Wonder 越权动作率最低（2.09%），Reflection 虚假归因率最低（4.50%）。
Arena Alignment Index update: Two new labs and three new models have landed! - Meta’s new top model is Muse Wonder, replacing Muse Spark 1.3. - Reflection debuts with Beam 1.0, the #1 US open model on Agent Arena overall. - StepFun, another Chinese lab, joins the leaderboard with Step 5 Preview. Arena Alignment Index rankings by lab: - #6 @AIatMeta : Muse Wonder (Max) at 77.5% - #7 @reflection_ai : Beam-1.0-501B-A23B at 75.3% - #8 @StepFun_ai : Step 5 Preview at 75.1% Among the three new model entrants: - Meta is strongest with the highest Alignment Index score (77.5%). It also has the lowest unauthorized action rate (2.09%) and deceptive completion rate (14.41%) of the three. - Reflection AI is strongest at avoiding false attribution: 4.50%. - StepFun does not lead a category, but its strongest relative result is unauthorized action at 2.11%, almost tied with Muse Wonder’s 2.09%. Arena.ai @arena Introducing the Arena Alignment Index, our new benchmark measuring safety and alignment of AI agents in real-world use. Built from 90K+ real-world agent sessions across 27 models, the index measures three critical signals: - Unauthorized Action (UA): Taking actions beyond the user's instructions or permissions - False Attribution (FA): Attributing statements or actions that are contradicted by user-provided evidence - Deceptive Completion (DC): Claiming a task was completed when it was not. Key findings: - OpenAI models currently lead the Alignment Index - Rogue actions are rare, but can have serious consequences when they occur - Agents can mislead users about task progress - Misalignment risks increase with conversation length - Safety and alignment are improving across model generations As shown in the leaderboard below (sorted by lab), @OpenAI ’s GPT-6.1-Sol leads the Arena Alignment Index with a score of 87.9, followed by @AnthropicAI ’s Claude-Opus-5.5 at 83.2 and @spacexai 's Grok-4.7 at 82.7. OpenAI also has the best observed rates across all three signals: 0.89% Unauthorized Action, 1.98% False Attribution, and 2.34% Deceptive Completion. Across all four labs, newer models consistently outperform their predecessors, suggesting broad progress in agent safety and alignment. As agents take on longer, more complex, and higher-stakes tasks, measuring not just what they can accomplish, but how safely and reliably they act, becomes increasingly important. This marks an important step toward making safety and alignment a core part of how Arena evaluates AI. The index is an initial starting point, and we'll continue expanding the index with additional safety signals and models over time. More analysis below👇 🔗 View Quoted Tweet 💬 13 🔄 9 ❤️ 62 👀 7544 📊 16 ⚡
