行业多源确认精选

Ethan Mollick 谈自主 AI 研究能力评估的局限

精选理由

Mollick 这条评论把"AI 能自主研究到什么程度"和"AI 能干多少有用活"分开了。他拿 Epoch 的 MirrorCode 和 OpenAI 报告的数字说话:写个 2-17 周的软件 AI 能自己搞定,但前沿研究另算。搞工程的、做预算的都该看看。

Ethan Mollick 在 X 上评论了关于 AI 自主完成研究工作追踪的最新讨论,认为这类追踪是对"AI 已能自主开展研究"等激进说法的有用反驳。他指出,这类评估聚焦于全球顶尖 AI 研究机构的研究任务,可能低估了 AI 在一般经济价值任务上的实际能力。

正文

他引用 Epoch 的 MirrorCode 结果说明:AI 已能自主重写研究人员估算需要人类 2-17 周才能完成的软件,这类定义明确的工作边界条件与研究任务截然不同。他还提到 OpenAI 报告中的数据:研究团队估算引入 coding agents 后,原本一个月的工作平均要花三个月。

Mollick 的结论是:AI 驱动的研究进展(RSI)与经济价值任务的进展可能并不紧密耦合,后者在各行业的差异和范围目前理解得更少。对开发者而言,适度的偶尔人工干预仍然能带来巨大的生产力提升。

原文 · Ethan Mollick

I think trying to track how much work AI can do autonomously is critical, and this is a useful counter to some of the most audacious claims about the state of autonomous AI research. But I do want to note that the focus on research tasks at the most advanced AI research organizations on the planet also runs the risk of substantially underestimating what AI can already do in terms of economically valuable tasks. Its worth separating the two (and I don't think Ramez is claiming they are not seperated).

Most work is not frontier AI research, and there AI can be tremendously successful. Epoch's MirrorCode results, for example, show AI autonomously reimplementing software that the researchers estimate would take a humans 2-17 weeks. This is well-specified work, so it has very different boundary conditions.

Plus, in the real world, some human intervention is fine (in my mind, vastly preferrable to no human role for a variety of reasons). Occasional guidance can still leave you with enormous productivity gains, even if that doesn’t satisfy the requirements for fully autonomous AI research. And even in the case of AI research, the same OpenAI report includes researchers estimating that a month of their team’s work would have taken three months without coding agents, on average.

In short, RSI/AI-driven research progress may not tightly couple with progress on economically valuable tasks, and the variance and range on those tasks are less well understood.

产业坐标与信源核验

本条情报归属 AITOP「行业」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Ethan Mollick、Epoch、MirrorCode、OpenAI,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「Ethan Mollick」(@emollick),经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 lmarena.ai、openclaw、rohanpaul_ai 等),属于近期高关注度行业信号。