研究：AI 编程智能体的合并 PR 更常需要修复，且七成修复由智能体自己完成
Who Finishes the Job? A Study of Follow-Up Fixes and Commit Authorship on AI Coding Agent Pull Requests
这篇论文统计了 Codex、Copilot、Devin 等五个智能体的 6774 个 PR，发现它们合并后更容易出问题，但大多自己悄悄修好了，数据挺有意思。
一项研究追踪了 6,774 个来自 OpenAI Codex、GitHub Copilot、Devin、Cursor、Claude Code 五个 AI 编程智能体的已合并 PR，并与同期 5,044 个人类 PR 作对照。结果显示，智能体 PR 被后续修复的概率是人类 PR 的 1.62 倍。在智能体 PR 的已验证修复中，69.6% 由同一个智能体完成，76.4% 的修复 PR 全部提交均出自智能体之手。研究通过人工标注者与 LLM 判官（Cohen's Kappa=0.78，直接修复精确率 90%）逐一验证了候选修复。
Who Finishes the Job? A Study of Follow-Up Fixes and Commit Authorship on AI Coding Agent Pull Requests
AI coding agents now author a large share of pull requests (PRs) merged into popular open-source projects. A merged agent PR is usually considered finished work; yet, prior studies have reported issues in agent code after the merge (e.g., code smells and static-analysis issues). However, little is known about how often a merged agent PR is fixed afterward, and who actually authors the fixing. In this paper, we follow 6,774 merged agent PRs across five AI coding agents (OpenAI Codex, GitHub Copilot, Devin, Cursor, and Claude Code) from the AIDev-pop dataset (open-source repositories with at least 500 stars) into their follow-up fixes, against a baseline of 5,044 contemporaneous human PRs from the same repositories. We link each merge to its candidate fixes, verify every candidate with human annotators and an LLM judge that matches human-level agreement (binary Cohen's Kappa=0.78 against a human-human K=0.77, Direct-fix precision 90%), and attribute the fixing work at the PR and the commit level. Our findings show that (1) merged agent PRs attract verified fixes at 1.62 times the odds of merged human PRs in the same repositories over the same period of time; (2) 69.6% of verified fixes in agent merges come from the same agent; and (3) 76.4% of the verified fix PRs are agent-authored throughout all commits. These results show that agents currently largely finish their own job, but their merges still require fixing more often than human merges.
