行业多源确认

Richard Sutton:单纯堆算力不够,需要全新的学习方法

The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts

精选理由

提出苦涩教训的 Sutton 本人又发话了,说光堆算力到不了智能,Tworek 也吐槽盲目扩 transformer 的风气,观点挺扎心。

图灵奖得主 Richard Sutton 重申其“苦涩的教训”观点,认为仅靠堆算力无法实现智能,需要根本性的新学习方法。前 OpenAI 研究员 Tworek 表示认同,称盲目扩大 transformer 规模“让一代科学家的大脑被 reward hacking 了”。已有一批初创公司押注这一方向。

原文 · Decoder

The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts

Turing Award winner Richard Sutton reaffirms that raw compute alone isn't enough for intelligence and that fundamentally new learning methods are needed. Ex-OpenAI researcher Tworek agrees, saying blind transformer scaling "has reward hacked brains of a whole generation of scientists." A growing wave of startups is already betting on exactly this gap. The article The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts appeared first on The Decoder .