论文

牛津研究团队发表论文称大模型无法真正“发明”新事物

Can we have a moratorium on “influencers” using the phrase “just published” for papers published in ...

精选理由

牛津研究团队发表新论文,通过数学论证指出,大模型(LLMs)无法真正“发明”新事物,因为它们本质上是预测下一个词的模型,无法相信现有数据中错误的信息。作者认为,人类能够基于现有数据提出新理论,而大模型则只能反映过去。作者每天使用这些模型,发现新突破通常来自人类判断现有数据错误并做出新理论。

牛津研究团队发表新论文,通过数学论证指出,大模型(LLMs)无法真正“发明”新事物,因为它们本质上是预测下一个词的模型,无法相信现有数据中错误的信息。作者认为,人类能够基于现有数据提出新理论,而大模型则只能反映过去。作者每天使用这些模型,发现新突破通常来自人类判断现有数据错误并做出新理论。

原文 · Gary Marcus

Can we have a moratorium on “influencers” using the phrase “just published” for papers published in ...

Can we have a moratorium on “influencers” using the phrase “just published” for papers published in 2024? Kanika @KanikaBK Oxford researchers just published a paper arguing LLMs cannot invent anything. Mathematically impossible. The reason is simple and brutal. A model trained to predict the next word can never believe something the existing data says is wrong. And every real breakthrough in history started with exactly that belief. In 1903 every prediction machine on Earth would have told the Wright Brothers that human flight was one to ten million years away. Nine weeks later they flew. Not because they had better data. Because they had a theory the data hadn't caught up to yet. That is the gap between AI and human thinking. LLMs mirror the past. Humans reason into a future that doesn't exist yet. Oxford just proved mathematically that those are two different things. I use these models every day. This matches what I see. The new stuff always comes from the human at the keyboard who decides the data is wrong. LLMs don't think. You do. 🔗 View Quoted Tweet 💬 2 🔄 2 ❤️ 12 👀 1433 📊 3 ⚡