MakerMaker.AI 谈自改进 AI 公司:人类与智能体协作而非替代
https://t.co/URbd8O8R0Z CEO Dhaval Adjodah and CTO Owen He on building a self-improving AI company w...
a16z 访谈 MakerMaker.AI 两位创始人,讲怎么判断递归自改进是真是假,还有专门拆台的工程师,聊法很实在。
a16z 发布了对 MakerMaker.AI CEO Dhaval Adjodah 和 CTO Owen He 的访谈,主题是递归自改进(RSI)。两人认为多数 RSI 项目只是用 AI 造更好的 AI,真正的标准是模型能改进自身权重、harness 和提示词,且收益要扣除成本后依然成立。公司内部设了实验开销追踪的 bleeder board,并安排一位工程师担任 Viceroy of Variance,专门破坏已有结果找问题。他们把整个公司视为多智能体系统,人类是其中一种智能体,数百次实验积累的直觉目前无法被智能体替代。
https://t.co/URbd8O8R0Z CEO Dhaval Adjodah and CTO Owen He on building a self-improving AI company w...
MakerMaker.AI CEO Dhaval Adjodah and CTO Owen He on building a self-improving AI company where humans and agents work as one system: "One big limit of [RSI] is the human element. I think the way that a lot of AI companies are thinking is, let us use AI to replace humans." "But what we found is that there's so much that good researchers and good engineers can bring to the table that's gonna be very hard to replace by agents." "And so that's why from the very beginning, we've tried to think of our basically entire company as a multi-agent system, where humans are a kind of agent that's cohabitating with other AI agents." "We have one of our engineers that we named the Viceroy of Variance. That's a real thing. His job is to go and destroy the results we have and find what's wrong." "So far we have not found a replacement for what we call quality time. Literally running hundreds of experiments, looking at it, developing an intuition, trying to figure out what is wrong, what is not wrong... what is just variance, what is not." @makermaker_ai @_dval_ Your browser does not support the video tag. 🔗 View on Twitter a16z @a16z MakerMaker.AI co-founders Dhaval Adjodah and Owen He with a16z's Martin Casado on recursive self-improvement, and how to tell when it's real: A lot of RSI pitches are really just people using AI to build better AI. Tech has always worked that way. You needed computers to build chips. Steam engines got better once you could get coal faster. Dhaval and Owen's bar is higher. The model has to improve itself: its weights, its harness, even the prompt that tells it what to work on next. And the gains have to hold up when you count what they cost. They track everyone's experiment spend on a "bleeder board," and one engineer, the Viceroy of Variance, has the job of breaking their results. Over the past few months, they've started seeing early signs of their system getting better and cheaper at the same time. 0:55 Why most RSI pitches miss 2:25 Optimizer vs. optimizee 5:10 The RSI equation: performance over cost 6:50 Why a closed loop does not mean takeoff 8:40 Humans are agents inside the system too 9:25 The denominator trap: progress divided by capital raised 11:40 Training GPT-2 for $100 13:40 Most RSI papers fail when replicated 16:40 Why you have to co-optimize 17:40 Why inference is the first problem 20:15 The agent rewrites its own prompt 22:20 "It's not a belief. It's happening." 25:00 Why they haven't published 27:50 Intelligence is a vector and Amdahl's law 29:45 The garden hose theory of RSI YouTube: youtu.be/3Q1mdn5ZGvM @makermaker_ai @_dval_ @martin_casado Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 1 🔄 0 ❤️ 8 👀 4730 📊 2 ⚡