产品

Hugging Face 推出 Paper Reproductions,用智能体独立复现论文实验

Help keep science open, try this out on Paper Pages: https://t.co/1cApLwjR7A

精选理由

Hugging Face 上线了个新玩法,丢一篇论文给智能体,它能自己跑实验做复现,帮你判断论文靠不靠谱。

Hugging Face 在 Paper Pages(hf.co/papers)上推出 Paper Reproductions 功能,可指定智能体独立复现一篇已发表论文的实验。其出发点是 Abubakar Abid 所述的三个问题:智能体让发现同质化、低质量论文泛滥难以筛选、公司更倾向将成果私有化。该功能通过产出开放的复现工件,为识别高质量论文提供更多信号。

图片来源 · Hugging Face
原文 · Hugging Face

Help keep science open, try this out on Paper Pages: https://t.co/1cApLwjR7A

Help keep science open, try this out on Paper Pages: hf.co/papers 🍉 Abubakar Abid @abidlabs 🚨 The incentives to share scientific knowledge openly are crumbling. Historically, researchers shared scientific knowledge for two primary reasons: (1) the prestige conferred by discovery, and (2) a sense of expanding the pool of human knowledge. Even within industry, scientific discovery was far too vast an endeavor for a single scientist or team to tackle alone. So scientists explored different frontiers, usually published their findings, and collectively moved the field forward. However, as more scientific knowledge is uncovered simply by throwing massive compute at autonomous agents with minimal human intervention, these incentives are breaking down: (1) discoveries are becoming commoditized. If anyone could have found the same result simply by running the same agentic prompt with enough compute, the prestige of discovery and the pride in one's work disappears, a shift we are already witnessing in software engineering. (2) the explosion of low-quality, low-barrier publications makes genuine breakthroughs increasingly difficult to filter, discover, and appropriately credit. (3) and for companies, keeping discoveries proprietary is increasingly advantageous. Instead of publishing and waiting for the broader scientific community to build upon the work, an organization can simply turn its own compute back onto the problem to iterate faster internally. In the short term, the incentives reward secrecy. But my goal -- and at Hugging Face, our goal -- is the sustainable, long-term expansion of human knowledge that survives individual, closed companies. So we have to build new tools that reward and facilitate open sharing of knowledge. If agents are accelerating discovery, we are going to figure out how to use agents and other tools to preserve scientific integrity. Starting with this: Paper Reproductions with ML Intern -- we’ve made it possible to take a published paper and task agents with independently reproducing its experiments, helping create more signals (e.g. open artifacts) that can help identify high-quality work. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 4 🔄 2 ❤️ 10 👀 4307 📊 4 ⚡