Astra模型训练成本达10亿美元
Do people agree on the $1B training compute bill for Astra? (My guess was a bit higher) (re scalin...
Gary Marcus质疑Astra 10亿美元训练成本，Nina Schick确认了这一数字并讨论了未来AI基础设施发展。
Astra模型使用了约10万块Blackwell GPU进行训练，训练计算成本约为10亿美元。该模型消耗约200兆瓦电力。随着首个千兆瓦级集群上线，AI基础设施的规模将进一步扩大。目前缺乏基础模型扩展数据，难以确定性能提升的具体原因。
Do people agree on the $1B training compute bill for Astra? (My guess was a bit higher) (re scalin...
Do people agree on the $1B training compute bill for Astra? (My guess was a bit higher) (re scaling: we aren’t getting data on base models and how they scale anymore; each new model includes both new base models and a lot of unrevealed harnesses, augmented data, etc, so it’s hard to know what is causing the improvements. zero science is being reported.) Nina Schick @NinaDSchick Scaling holds. Astra was trained on ~100k Blackwell GPUs with an estimated $1bn training compute bill and ~200 MW of power. What happens when the first-gigawatt cluster comes online? We have yet to see the full force of the infrastructure (hardware and energy) being built now. Obviously, there is more Intelligence coming. 🔗 View Quoted Tweet 💬 1 🔄 0 ❤️ 10 👀 3361 📊 2 ⚡
