Ripple-65B Preview 训练成本仅 3200 万美元
精选理由
65B 开源编程模型把成本压到上代 SOTA 的十分之一，训练细节都在这条推文里，做模型的人可以看看。
Ripple-65B Preview 是一个开源权重模型，官方称全部研发成本为 3200 万美元，涵盖预训练阶梯开发、数据混合、评测、合成数据生成和最终训练。这一价格约为此前开放权重 SOTA 智能体编程模型成本的十分之一。发文者将其称为开源模型 SOTA 的'复仇者联盟'组合。
原文 · swyx (AI Engineer)
> we developed and trained Ripple-65B Preview for only $32M, which is one-tenth the cost of the previous open-weight SOTA on agentic coding¹
this is like the avengers of open model SOTA
¹ "Note that $32M is our full R&D cost starting from scratch, including pretraining ladder development, data mixing, evals, debugging, synthetic data generation, posttraining recipe development, and the final hero pretraining and posttraining run."
