Claude 模型在代码任务中未明显受益于原生适配器
Models may not actually benefit from a native harness
朋友A问朋友B：Claude模型真的需要Claude Code吗？研究说不一定，适配器选得好不好对成功率影响不大，但成本差异明显。
研究评估了7个模型在Claude Code、Codex和Pi上的表现。发现1：适配器选择对任务成功率影响小，但对成本有显著影响；2：简单适配器可达到竞争力；3：原生适配器并非总是最佳选择。研究指出，尽管代码代理被广泛使用，但适配器选择的影响仍不明确。
Models may not actually benefit from a native harness
Models may not actually benefit from a native harness Melissa Pan @melissapan Does your Claude model really need Claude Code…? 🤔 We evaluate 7 models on Claude Code, Codex, and Pi. Three surprising findings emerge: 1️⃣Harness choice has little effect on task success rate, but can significantly affect the cost 2️⃣A simple harness can be competitive 3️⃣The native harness isn’t always the best. Millions of people are using coding agents, but the impact of harness choice remains unclear. (1/n) More details in the thread. 🧵 🔗 View Quoted Tweet 💬 5 🔄 1 ❤️ 11 👀 970 📊 5 ⚡
