Mistral 在欧洲数据中心用 3800 块 Grace Blackwell GPU 训练 ML4
Mistral 晒了训练 ML4 的家底：3800 块 Grace Blackwell，全在欧洲机房，后面还有 C 轮 D 轮集群要上线。
Mistral 的 Guillaume Lample 透露 ML4 在欧洲数据中心完成训练，使用了 3800 块 NVIDIA Grace Blackwell GPU。训练集群位于法国 Bruyères-le-Châtel，由 Series B 融资建设。公司还表示 Series C 和 Series D 的集群即将上线，用于更长时间的训练和更激进的 post-training。
We’re building AGI from this train station Guillaume Lample @ NeurIPS 2024 @GuillaumeLample ML4 was trained on 3,800 NVIDIA Grace Blackwell GPUs in our European datacenters -- our cluster in Bruyères-le-Châtel built using our Series B fundraise. We are investing heavily in infrastructure, with our Series C and D clusters coming online soon. This additional compute will let us train longer, pursue more ambitious post-training, and iterate faster. We expect large and rapid improvements in the weeks and months ahead. 2/n 🔗 View Quoted Tweet 💬 17 🔄 24 ❤️ 195 👀 2997 📊 37 ⚡
