行业多源确认

John Schulman 与 Mark Chen 对谈:模型的"研究品味"能否通过 RLHF 学会

精选理由

OpenAI 和 Thinking Machines Lab 的两位核心人物同台聊 AI 自动做研究这件事。Chen 直说模型还只会调参数不会提想法,Schulman 给出了用 RLHF 培养研究品味的具体方案。做 AI 研究或想了解前沿实验室怎么思考 RSI 的人都该看看。

a16z 播客 Working Theory 第一期上线,Sarah Wang 与 OpenAI 首席研究官 Mark Chen、Thinking Machines Lab 联合创始人 John Schulman 讨论递归自我改进(RSI)。Schulman 认为"研究品味"指判断哪些想法长期重要、能超越原始论文并与其它想法组合的能力。Chen 指出当前模型在品味上表现不佳,只是擅长超参数优化等可调参数的深度调优。

图片来源 · a16z
正文

Schulman 提出两条培养路径:一是从领域历史文献中吸收前人经验,二是用 RLHF 从研究者那里收集"哪些想法好、哪些不好"的数据,把人类直觉烘焙进模型。节目还讨论了 RSI 的定义、距离完全实现还有多远,以及为什么 AI 可能是解决对齐问题的工具。

原文 · a16z

John Schulman and Mark Chen on what research taste is, and how models might learn it: John: "Research taste is about knowing which ideas are important in the long run, which ideas really catch on and end up going beyond whatever paper they first appear in, but being general and being composable with other ideas." Mark: "There's taste, which is how you come up with the idea in the first place. The models are still not phenomenally good at taste. They go very deep into things like hyperparameter optimization, essentially tuning all the little knobs that you can tune." John: "A lot of intuition just comes from personal experience doing research, but to get good at a certain research field, you also have to read a lot of the past work in that field, and you try to absorb the lessons from all this historical work." "Companies will probably also just do RL from human feedback to collect data from researchers on which proposed ideas are good and which aren't. And that's kind of like absorbing whatever human intuitions the human researchers have developed and trying to bake that into the models." @johnschulman2 @markchen90 @sarahdingwang

产业坐标与信源核验

本条情报归属 AITOP「行业」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:John Schulman、Mark Chen、OpenAI、Thinking Machines Lab,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「a16z」(@a16z),经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 向阳乔木、IT之家、OpenAI Blog 等),属于近期高关注度行业信号。