Kimi K3.1 Pro 登顶 Artificial Analysis 网络防御开源模型榜首
Moonshot 的 Kimi K3.1 Pro 在网络防御基准拿了开源模型第一，CyberGym-E2E-AA 得分 95% 连 GPT-6 Sol 都被超过，不过单任务成本反而变贵了，这篇把各家分数和价格都列得很清楚。
Moonshot 的 Kimi K3.1 Pro 在 Artificial Analysis Cyber Index 上得分 64%，成为排名第一的开放可用模型，领先 DeepSeek V4.1 Flash 1017（57%）7 分，仅次于 OpenAI 受限访问的 GPT-6 Sol（Daybreak Blue，69%）。相比 Kimi K3 的 41%，K3.1 Pro 提升 23 分，并在 CyberGym-E2E-AA 上以 95% 超过 GPT-6 Sol（93%）。该指数由 CWE-Bench-AA、DeepsecBench-AA 和 CyberGym-E2E-AA 三个基准组成，衡量智能体网络防御能力。成本方面，K3.1 Pro 的单任务成本为 2.81 美元，虽代币价格比 Kimi K3 便宜 33%，但因输入 token 翻倍反而高出 15%。
Kimi K3.1 Pro is the new #1 openly-available model for agentic cyber defense, behind only trusted-access model GPT-6 Sol (Daybreak Blue) on the Artificial Analysis Cyber Index
@Kimi_Moonshot's Kimi K3.1 Pro scores 64% on the Artificial Analysis Cyber Index, 7 points ahead of the previous leading openly-available model, DeepSeek V4.1 Flash 1017 (57%), and 5 points behind GPT-6 Sol (Daybreak Blue, max, 69%), which is only available through OpenAI's trusted-access program. Once the weights for K3.1 Pro are released, K3.1 Pro will also be the leading open weights model for cyber defense.
The Artificial Analysis Cyber Index measures capability on agentic cyber defense tasks and is composed of three benchmarks: CWE-Bench-AA, DeepsecBench-AA and CyberGym-E2E-AA. The Index primarily evaluates models through their publicly accessible APIs, reflecting the cyber capabilities available to developers.
Proprietary models from OpenAI, Anthropic and Google may have stronger cyber capabilities but lose points to safety refusals: GPT-6 Sol (Daybreak Blue, max), available through OpenAI's trusted-access program, scores 32 points above its public counterpart. Kimi K3.1 Pro encounters no safety refusals.
Key results:
➤ #1 openly-available model and #2 overall: Kimi K3.1 Pro scores 64%, up 23 points from Kimi K3 (41%) and ahead of DeepSeek V4.1 Flash 1017 (57%). Only the trusted-access GPT-6 Sol (Daybreak Blue, max, 69%) scores higher
➤ Highest CyberGym-E2E-AA score of any model: K3.1 Pro scores 95% on CyberGym-E2E-AA, placing it ahead of GPT-6 Sol (Daybreak Blue, 93%) and the next openly-available model, Mistral Large 4 (82%). On DeepsecBench-AA, K3.1 Pro scores 37%, behind GPT-6 Sol (Daybreak Blue, 48%) and GPT-6 Sol (46%). On CWE-Bench-AA it scores 61%, 4 points behind GPT-6 Sol (Daybreak Blue, 65%), with DeepSeek V4.1 Flash 1017 leading at 69%
➤ 15% increase in Cost per Task despite lower token prices: K3.1 Pro has a Cost per Task of $2.81, higher than GPT-6 Sol (Daybreak Blue, max, $1.77) and DeepSeek V4.1 Flash 1017 ($0.42). Kimi K3.1 Pro is 33% cheaper per token than Kimi K3 ($2/$10 vs. $3/$15 per 1M input/output tokens), but uses ~2x more input tokens, resulting in a 15% higher Cost per Task ($2.81 vs. $2.45)
