苹果研究提出新方法优化扩散语言模型训练
DACA-GRPO: Denoising-Aware Credit Assignment for Reinforcement Learning in Diffusion Language Models
苹果研究的新方法DACA-GRPO，能更精准地优化扩散语言模型的训练过程，和传统方法相比，它解决了去噪步骤的信用分配问题。
苹果研究团队提出Denoising-Aware Credit Assignment for GRPO（DACA-GRPO）方法，针对扩散语言模型训练中所有去噪步骤被同等对待的问题，通过解决时间上的信用分配和均值场似然估计的系统性偏差，提升训练效果。
DACA-GRPO: Denoising-Aware Credit Assignment for Reinforcement Learning in Diffusion Language Models
Diffusion large language models are a compelling alternative to autoregressive models, yet existing RL methods for diffusion treat all denoising steps as equally important and rely on biased, high-variance likelihood estimates. We identify two fundamental weaknesses: the absence of temporal credit assignment across the denoising trajectory, and the systematic bias of mean-field likelihood estimates used for policy optimization. To address these, we propose Denoising-Aware Credit Assignment for GRPO (DACA-GRPO), a lightweight, plug-and-play enhancement for any GRPO-style trainer. DACA-GRPO…
本条情报归属 AITOP「模型」核心栏目，重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中，该动态直接关联「中美大模型技术代差与商业化对照」研究主线，反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括：Denoising-Aware Credit Assignment for GRPO、GRPO、扩散语言模型、苹果，读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明：本文原始信息发布自一手权威信源「Apple ML Research」（Tier-1 一手发布），具备高确定性参考价值。
