论文精选

研究LLM训练的电力弹性特性,提出Power Flexibility Index(PFI)指标

Characterizing Job Power Elasticity for Power-Flexible AI Training

精选理由

这是关于如何让AI训练更节能的研究,作者通过大量实验数据,提出了一个叫PFI的指标,能帮助在功率受限时优化训练效率,挺实用的。

这篇论文首次系统性地研究了LLM训练作业的电力弹性(job power elasticity),即GPU功率降低时吞吐量的变化敏感性。作者收集了131次LLM训练运行的数据(使用H200和H100 GPU),包括密集型和混合专家模型,发现训练作业表现出显著的但可变的电力弹性。他们提出了Power Flexibility Index(PFI)这一标准化指标来量化功率降低带来的性能成本,并识别出可在运行时预测PFI的遥测信号。最终证明,基于PFI的功率分配在功率限制下能最大化总令牌/秒吞吐量。在30%功率降低时,PFI感知的功率分配能恢复约1.5k tokens/s/作业,弥补了63%的与最优分配之间的性能差距。

原文 · arXiv cs.AI

Characterizing Job Power Elasticity for Power-Flexible AI Training

Large language model (LLM) training is among the fastest-growing sources of electricity demand in modern data centers, and power availability is a primary bottleneck to continued AI infrastructure growth. Making the power consumption of these workloads flexible could unlock additional power for AI growth, limit increases in electricity prices, and improve the utilization of existing grid infrastructure. However, to realize this flexibility, we must first understand how the performance of training workloads changes when GPU power is reduced. This paper presents the first systematic characterization of \emph{job power elasticity} (the sensitivity of throughput to power reductions) in LLM training. To quantify elasticity, we introduce the \emph{Power Flexibility Index (PFI)}, a normalized metric that quantifies the performance cost of power reductions and provides a control primitive for SLA-aware power flexibility. We collect data from 131 LLM training runs on H200 (plus 24 H200 validation runs and 34 matched H100 runs), including both dense and mixture-of-experts models, pretraining and fine-tuning tasks, and up to 32 GPUs. We find that LLM training jobs exhibit substantial but variable power elasticity, and we identify telemetry signals that predict PFI at runtime. Finally, we demonstrate that PFI-aware power allocation maximizes total tokens/second throughput under power constraints. Under a 30\% power reduction, PFI-aware power allocation recovers ~1.5k tokens/s per job, 63\% of the performance gap between an equal-weight allocation and an oracle with perfect information. Our results establish power elasticity as a measurable property of training jobs and provide a foundation for power-aware, grid-responsive AI infrastructure.