智能体评测终于从玩具任务走向真实场景——做 AI 应用或智能体开发的团队，可以直接用 Arena 的评测结果来选模型，比跑基准测试更有参考价值。
Agent Arena 是一个全新的智能体评测平台，通过数百万次真实用户会话，衡量模型在完成实际任务（如编写代码、创建幻灯片、网页研究、构建应用、分析文档）时的表现。评测基于五个信号：任务成功率、可操控性、错误恢复、用户表扬/抱怨比、工具幻觉。排行榜基于 30 万+任务、200 万+工具调用和 4000 万行代码构建，当前排名第一为 OpenAI GPT-5.5，其次为 Anthropic Claude Opus 4.7、智谱 GLM-5.1、Google Gemini 3.1 Pro 和 Kimi K2.6。该平台旨在解决智能体在真实场景中难以评估的问题，为开发者提供更贴近实际使用的性能参考。
Introducing Agent Arena: real-world agentic evals at scale. How do you evaluate agents doing actual...
Introducing Agent Arena: real-world agentic evals at scale. How do you evaluate agents doing actual work? We measure millions of live sessions where real users accomplish real tasks. On Arena, models now get web search, filesystem, and terminal tools to complete complex workflows: writing code, creating slide deck, researching the web, building apps, and analyzing documents. Every session produces rich signals. Users iterate with the agent turn-by-turn: approving, editing, correcting, praise or expressing frustration. The environment gives feedback too: shell errors, tool failures, recovery attempts, and more. Our leaderboard measures each model's agentic performance using causal inference across five signals: task success, steerability, error recovery, user praise vs. complaint, and tool hallucination. This leaderboard snapshot is built from 300K+ tasks, 2M+ tool calls, and 40M lines of code by agents. Top labs in Agent Arena: - #1 @OpenAI : GPT-5.5 (High) - #2 @AnthropicAI : Claude-Opus-4.7 (Thinking) - #3 @Zai_org : GLM-5.1 - #4 @GoogleDeepMind : Gemini-3.1-Pro - #5 @Kimi_Moonshot : Kimi-K2.6 More analysis in the thread, with the full technical blog below. Arena.ai @arena Introducing Agent Mode: Agentic AI is now measured in the Arena. Agent Mode can do deep research, create reports, generate images, build websites, debug code, and more. It completes more complex tasks by using tools like web search, bash in a sandbox environment, image generation, file writing, and asking follow-up questions. Frontier models are waiting for you in Agent Mode to take on real-world tasks. GPT-5.5, Claude Opus 4.7, Gemini 3.1 Pro, and top open models. Test them yourself. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 5 🔄 11 ❤️ 64 👀 4529 📊 13 ⚡