CoreWeave 推出 Mission Control,帮 Cognition 保障数千 GPU 训练稳定性
CoreWeave 上线 Mission Control,能在数千张 GPU 的训练里自动换掉坏节点,还有 GPU Straggler Detection 找出拖慢同步任务的那一张卡。跑大训练的人可以看看。
CoreWeave 推出 Mission Control 工具,随 CoreWeave Cloud 附带提供。它能在不健康节点影响吞吐量之前自动替换这些节点。Cognition 的 Silas Alberti 解释了可靠性是选择 CoreWeave 的原因:一次跨数千 GPU 的训练运行中,单个副本宕机会让整个任务停止。另有处于预览阶段的 GPU Straggler Detection 功能,用于找出拖慢同步任务的那一块 GPU。
Reliability is what keeps @cognition on CoreWeave. @silasalberti explains why.
On a run across thousands of GPUs, one replica going down stops the whole thing.
CoreWeave Mission Control is included with CoreWeave Cloud.
It replaces unhealthy nodes before they hurt throughput, and GPU Straggler Detection, in preview, finds the one GPU dragging a synchronous job. https://t.co/hZlnIOPgei