论文

研究:LLM 优化代码省时间不省电,多数方案能耗反超人工

Green Code or Costly Code? Evaluating the Energy Costs of Iterative LLM-Based Code Optimizations

精选理由

想让 AI 帮你优化代码前先看这篇:11 个模型实测下来,42/44 的“优化”代码反而更耗电,MoE 架构是最省能的选择。

arXiv 论文对 11 个开源模型在 EffiBench 全部 1000 道题上进行测试,测量 LLM 自我精炼优化代码的能耗。推理能耗跨度为 0.79 至 8.68 MJ,约等于 250 到 2800 次 GPT-4.1 查询。44 个配置中有 42 个生成的代码比人类参考解法每题多耗能 4% 至 886%,仅 2 个配置有微弱收益,回本需执行 10^6 至 10^7 次。限制最大输出 token 数最多可降低 69% 能耗,MoE 架构比同等规模稠密模型显著更省电。

原文 · arXiv cs.AI

Green Code or Costly Code? Evaluating the Energy Costs of Iterative LLM-Based Code Optimizations

Large Language Models (LLMs) are increasingly used to optimize code for performance. This practice often assumes that improvements in execution speed naturally translate into overall lower energy consumption. We challenge this assumption empirically by measuring whether performance-optimized code produced by LLM self-refinement pipelines is also energy-efficient relative to canonical human reference solutions, and whether the energy cost of the optimization process can be offset by subsequent execution-time savings. We evaluate 11 open-source models across four decoding configurations on all 1,000 problems of EffiBench, a state-of-the-art performance benchmark, while collecting per-process, hardware-level energy measurements throughout. Inference energy spans 0.79 to 8.68 MJ across model-variant pairs, which is roughly equivalent to the energy of 250 to 2800 GPT-4.1 queries. Limiting the maximum number of output tokens has the largest impact, reducing energy use by up to 69% compared to the default configuration. On the execution side, 42 of 44 configurations produce code that consumes more energy per problem than the canonical human reference, with overheads ranging from +4% to +886%. The two exceptions achieve only marginal gains, with break-even points on the order of 10^6 to 10^7 executions. Mixture-of-Experts architectures consume substantially less inference energy than equivalently-sized dense models without sacrificing correctness, making architectural choice a more consequential sustainability lever than decoding parameters. Performance optimization and energy efficiency are not always aligned goals: LLM self-refinement consistently produces faster-seeking but energy-heavier code relative to what a human engineer would write. All artifacts are available at https://doi.org/10.5281/zenodo.23598170.