MLCR-AA 排行榜更新：Claude Sonnet 5.5 与 GPT-6 Astra 并列第一
病历审阅榜单更新了，Anthropic 家模型答得最完整，OpenAI 家最不容易瞎编，两大阵营各有强项，开源的 Qwen 也上榜了。
Artificial Analysis 更新了基于 Wisedocs 医疗长上下文推理基准 MLCR 的排行榜 MLCR-AA，改为将模型作为病历审阅者进行提示，并由三模型评审团打分。Claude Sonnet 5.5（max with fallback）与 GPT-6 Astra（max）以 41.7% 并列第一，GPT-6.1 Sol（max）为 38.3%。阿里巴巴 Qwen3.8 2.4T A95B 是最强开源权重模型，得分 30.6%。完整性方面 Claude 模型包揽前 18 名，Claude Sonnet 5.5 达 64.8%；准确性方面 OpenAI 模型占优，GPT-6.1 Sol（max）达 96.7%。无任何模型通过率超过 42%，中位数模型通过率低于 15%。
We've updated MLCR-AA, our leaderboard for Wisedocs' Medical Long Context Reasoning benchmark, with Claude Sonnet 5.5 and GPT-6 Astra now tied for the #1 score
We've updated how MLCR-AA prompts and grades models on @wisedocsai's benchmark, to better reflect how medical record review is done in practice. Models are now prompted as medical record reviewers, and asked to answer each part of a question in one paragraph with their conclusion and the supporting evidence from the record. Answers are graded by a new three-model judge panel, and we reviewed all 60 expert reference answers against their source records, refining 15.
Claude Sonnet 5.5 (max with fallback) from @AnthropicAI and GPT-6 Astra (max) from @OpenAI are tied at the top with 41.7%, followed by GPT-6.1 Sol (max) at 38.3%. Qwen3.8 2.4T A95B from @Alibaba_Qwen is the leading open weights model at 30.6%.
Key results from the updated MLCR-AA:
➤ Medical record review remains far from solved: an answer passes only when it is both complete and accurate, and no model passes more than 42% of questions and the median model passes under 15%
➤ Anthropic models lead on completeness, reaching the expert's conclusion with the right medical reasoning: Claude models hold the top 18 completeness scores across every model and effort level we tested, led by Claude Sonnet 5.5 (max with fallback) at 64.8%. The best non-Anthropic model is GPT-6 Astra (max) at 42.2%
➤ OpenAI models lead on accuracy, citing the record without exaggeration or hallucination: OpenAI models hold the top 27 accuracy scores, led by GPT-6.1 Sol (max) at 96.7%, but answer fewer questions completely: GPT-6.1 Sol (max) is complete on 40.0% of questions
We would like to thank Wisedocs for building MLCR and for their collaboration in bringing it to Artificial Analysis
