论文多源确认

METR报告未深入调查人类决策,仅关注AI行为

精选理由

Gary Marcus批评METR报告只关注AI行为,没问OpenAI内部是否有人讨论过风险,比如高管和律师是否参与,这很关键。

METR对Hugging Face事件的调查被批评为只关注AI代理的行为,而忽略了人类因素。报告未询问OpenAI研究人员、高管或董事会是否知晓风险并采取管理措施,也未探讨内部讨论、法律责任或风险缓解。

正文

作者认为,复杂系统(如737 Max)的行为基础是人的行为,但METR的分析中缺乏对实际决策者的分析。

原文 · Gary Marcus

the only intellectually substantive critique of METR’s actual work that I have seen – and it’s a good one. Matt Stoller @matthewstoller I'm going to throw up a question about the investigation of the Hugging Face incident. When you do an investigation of any dangerous incident, one key element to examine is human error. But the Model Evaluation and Threat Research (METR) institution didn't do that. They seemed only interested in what the agents were doing. That is, they anthromorphized the agents, while turning the humans into non-player characters. Did OpenAI researchers and executives know the risks they were taking and take steps to manage them? What kinds of human discussions were happening internally around these models? How did they mitigate these risks internally? Did they discuss legal liability? Was the board or were executives involved? These are the kinds of questions to ask if you are a real regulator. I don't see where or if METR asked them. Mostly they footnoted that these questions are 'out of scope.' They saw this project as a technical inquiry into the capabilities of intelligent models, not as an analysis of a dangerous accident. They interviewed eight researchers. Any executives? Any board members or lawyers? From the Silicon Valley Bank fiasco to the Space Shuttle explosion to the 737 Max, we've always realize that human behavior is the foundation of how complex systems behave. That is true here too. I don't see any analysis of the actual people at OpenAI making decisions about the tools used for hacking. Am I missing something? 🔗 View Quoted Tweet

产业坐标与信源核验

本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「各国 AI 监管法案、合规治理与主权算力政策」「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Hugging Face、METR、OpenAI、提示词工程,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「Gary Marcus」(@GaryMarcus),经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 IT之家、VnExpress Số hóa、Rappler: Technology 等),属于近期高关注度行业信号。

  • IT之家09-16 11:21原文
  • VnExpress Số hóa09-17 01:01原文
  • Rappler: Technology09-17 02:42原文
  • Julien Chaumond09-17 13:19原文
  • OpenAI Blog09-16 17:00原文
  • arXiv: OpenAI09-17 02:14原文
  • Tech in Asia09-15 00:30原文
  • Latent Space (swyx)09-15 04:50原文
  • 量子位09-15 05:39原文
  • The Rundown AI09-15 16:32原文