Behnam Neyshabur 提出单人预训练前沿大模型计划,获 $10M 资助
一个学者想证明单人也能做前沿大模型预训练,还真拿到了1000万美元,Manning 都在围观这事。
学者 Behnam Neyshabur 提出一个目标:让单个研究者就能完成前沿性能大语言模型的预训练。斯坦福教授 Christopher Manning 对此表示兴奋兼怀疑,质疑一个人能否与大厂的大团队竞争。该计划随后获得 $10M 的资助,由 mirendil 提供。Manning 称这一金额对学术预算而言已相当慷慨。
I reacted with excitement but also skepticism to @bneyshabur’s plan for making frontier-performance LM pre-training possible by a single researcher.
Could 1 person compete with the huge teams at big co’s?
$10M is generous for an academic budget, but @mirendil has delivered!!!