V4.1-1017 评测:智能体任务大幅提升,浏览器使用却出现回退
一份按任务拆开的模型评测:智能体和推理涨了,浏览器操作反而掉分,价格还便宜一半,信息挺细。
V4.1-1017 在智能体类任务上从 Muse Spark 1.3 提升到 Muse Wonder 1.0,进步幅度明显。推理能力约从 Sonnet 4.6 水平升到 Opus 4.8 水平,编程和设计也有提升。数据分析能力持平,但价格降到原来的 1/2。浏览器使用和研究(Research)两类任务出现回退。
not like it's a very high signal eval, but the composition is interesting. V4.1-1017 MASSIVELY improves on "agentic", from Muse Spark 1.3 to Muse Wonder 1.0. Reasoning: Sonnet 4.6 to Opus 4.8. Coding, Design – gains. Data analysis – stagnant but 2x cheaper. Browser use, Research – REGRESSIONS.