行业

xAI 联合创始人 Igor Babuschkin:强力 AI 模型应归还公共领域

精选理由

xAI 联合创始人 Igor Babuschkin 发长文说训练数据取自公共互联网,模型就该开源还给公众,Mistral 的 Arthur Mensch 也转发了。开源闭源之争从 license 层面聊到伦理层面,做模型、用模型的人都值得看原文。

xAI 联合创始人 Igor Babuschkin 发文提出一套 LLM 训练数据伦理观点:预训练用数万亿 token 蒸馏了互联网上人类集体创作的成果,包括 GitHub 上的开源代码,AI 公司却把这些免费共享的内容训练成模型,再以数千亿美元估值出售。他认为这条路在伦理上站不住脚。

正文

但他同时承认无法对训练数据提出强版权主张——LLM 和人类一样是学习并合成新内容,而非照搬原文,禁止模型学习就得解释为何允许人类这样做。他给出的解法是把训练出的模型开源放回公共领域,让数据以更有用的形式回馈社会,而非只为少数人牟利。这正是 open-weight 模型的核心理念,且开源模型已开始与闭源实验室的模型竞争。

这条推文由 Mistral CEO Arthur Mensch 转发并附和。作为在闭源大厂任职的从业者公开支持开源路线,这一表态对开源与闭源之争、以及训练数据合规讨论都有直接参照意义。

原文 · Arthur Mensch

I am confident humanity will ensure that powerful AI models are returned to the commons Igor Babuschkin @ibab There’s a way of thinking about the ethics of building LLMs which deserves much more attention: During pretraining of LLMs we distill vast amounts of humanity’s collective work from the internet into the model’s weights. When that knowledge was created, we were not aware that LLMs would be possible. The content was released for others to read freely, essentially as a common good. This includes not only all of our writing, but also the vast amounts of open source code on platforms like GitHub. Once LLMs were discovered, AI companies were able to access the content easily (in the trillions of tokens), train powerful models and then sell them back to us for hundreds of billions of dollars. They took something we released for free for the common good, and then turned it into trillion-dollar companies to primarily benefit themselves. Coding models in particular, trained from GitHub, are very useful and highly profitable. At the same time, I believe that we can’t make a strong copyright claim on all of the training data. LLMs, similar to humans, do not perfectly reproduce the source text, but rather learn from it and then synthesize new content. If we wanted to forbid LLMs from learning from it, we would need to answer why humans are allowed to do the same. There is an elegant way to resolve this tension: We should return the resulting models to the commons, releasing them openly for anyone to download and use freely. This way the data is not repurposed for a few people’s profit, but merely transformed into a more useful form for society. This is the core idea behind open-weight models, which are gathering momentum and are starting to rival the models of proprietary AI labs. After working in the AI industry for many years, building many LLMs, I’ve come to strongly believe that this is the right point of view. Although most people today don’t seem to think along these lines, I believe that in the fullness of time this will become the majority opinion and the current state of AI development will look odd in retrospect. Provided the models haven’t taken over at that point. 🔗 View Quoted Tweet📊 16 ⚡

产业坐标与信源核验

本条情报归属 AITOP「行业」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「中美大模型技术代差与商业化对照」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Igor Babuschkin、xAI、Mistral、开源模型,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「Arthur Mensch」(@arthurmensch),经 AITOP 多维评分管线结构化提炼。