行业73°

OpenAI投入20%计算资源应对对齐问题,Marcus呼吁投资替代方案

Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of r...

精选理由

Gary Marcus指出OpenAI用20%算力监控对齐问题,证明LLM架构有缺陷,呼吁投资替代方案。

AI 摘要

OpenAI将20%的研究推理计算资源用于思维链监控,显示对齐问题日益严重。Gary Marcus认为这表明LLM架构在对齐方面正在失败。他呼吁业界投资更多替代LLM的方案,并制定跨实验室的通用政策和标准。

原文 · Gary Marcus

Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of r...

Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-thought monitoring [suggesting] that suggests that alignment issues are becoming a pretty serious concern” we need to invest more heavily in alternatives to LLMs because LLM-centered architectures are failing to yield alignment. I don’t know how much more evidence we need for that. (but yes, we also do need coherent policies, as @emollick rightly suggests) Ethan Mollick @emollick If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-thought monitoring, that suggests that alignment issues are becoming a pretty serious concern. We really need universal policies & standards across labs. 🔗 View Quoted Tweet 💬 6 🔄 4 ❤️ 32 👀 5724 📊 8 ⚡

  • The Rundown AI08-19 10:30原文
  • OpenAI Blog08-18 11:00原文
  • techcrunch08-18 18:00原文
  • Sam Altman08-18 18:53原文
  • Nathan Lambert: Interconnects08-17 15:07原文
  • IT之家08-17 15:20原文
  • Lenny Rachitsky08-17 20:36原文
  • arXiv: OpenAI08-17 22:11原文
  • 爱范儿08-18 00:47原文
  • AI Breakfast08-18 03:39原文
OpenAI投入20%计算资源应对对齐问题,Marcus呼吁投资替代方案 · AITOP · AI热报