行业精选

MakerMaker.AI 创始人谈递归自我改进:性能除以成本才算数

https://t.co/URbd8O8R0Z co-founders Dhaval Adjodah and Owen He with a16z's Martin Casado on recursiv...

精选理由

a16z 播客聊递归自我改进,MakerMaker.AI 两个创始人讲怎么判断 RSI 是真是假,还提到 100 美元训练 GPT-2,挺有意思。

MakerMaker.AI 联合创始人 Dhaval Adjodah 和 Owen He 与 a16z 的 Martin Casado 对谈递归自我改进(RSI)。他们认为多数 RSI 项目只是用 AI 造更好的 AI,他们的标准是模型自己改写权重、运行框架甚至提示词。团队用 bleeder board 追踪实验开销,并设专人负责复现失败结果,衡量标准是性能提升除以成本。过去几个月他们观察到系统在变强的同时成本在下降。

图片来源 · a16z
原文 · a16z

https://t.co/URbd8O8R0Z co-founders Dhaval Adjodah and Owen He with a16z's Martin Casado on recursiv...

MakerMaker.AI co-founders Dhaval Adjodah and Owen He with a16z's Martin Casado on recursive self-improvement, and how to tell when it's real: A lot of RSI pitches are really just people using AI to build better AI. Tech has always worked that way. You needed computers to build chips. Steam engines got better once you could get coal faster. Dhaval and Owen's bar is higher. The model has to improve itself: its weights, its harness, even the prompt that tells it what to work on next. And the gains have to hold up when you count what they cost. They track everyone's experiment spend on a "bleeder board," and one engineer, the Viceroy of Variance, has the job of breaking their results. Over the past few months, they've started seeing early signs of their system getting better and cheaper at the same time. 0:55 Why most RSI pitches miss 2:25 Optimizer vs. optimizee 5:10 The RSI equation: performance over cost 6:50 Why a closed loop does not mean takeoff 8:40 Humans are agents inside the system too 9:25 The denominator trap: progress divided by capital raised 11:40 Training GPT-2 for $100 13:40 Most RSI papers fail when replicated 16:40 Why you have to co-optimize 17:40 Why inference is the first problem 20:15 The agent rewrites its own prompt 22:20 "It's not a belief. It's happening." 25:00 Why they haven't published 27:50 Intelligence is a vector and Amdahl's law 29:45 The garden hose theory of RSI YouTube: youtu.be/3Q1mdn5ZGvM @makermaker_ai @_dval_ @martin_casado Your browser does not support the video tag. 🔗 View on Twitter 💬 3 🔄 3 ❤️ 31 👀 7960 📊 7 ⚡