斯坦福提出新并行策略提升扩散模型训练效率

59倍加速，在块扩散微调中达到1.61倍加速。

使用该策略训练的模型在SWE-bench和Terminal-Bench基准测试中表现更好。

Introducing Context-Sharded Block Parallelism (CSBP), a new distributed parallelism strategy enabling significant training efficiency for diffusion LLMs, with gains that grow with context length 🚀 ⚡ 7.59× faster DFlash2 speculative decoding drafter training ⚡ 1.61× faster block diffusion fine-tuning ⚡ 1.33× faster autoregressive → block diffusion adaptation Tarun Suresh @ COLM 2026 @TarunSures41845 Diffusion LLMs and speculative decoding promise much faster agents. Yet agents need long contexts, and training on them is painfully slow. Introducing Context-Sharded Block Parallelism (CSBP), a new distributed parallelism strategy unlocking significant training efficiency for diffusion LLMs, with speedup gains growing with context length 🚀 ⚡ 7.59× faster DFlash2 speculative decoding drafter training ⚡ 1.61× faster block diffusion fine-tuning ⚡ 1.33× faster autoregressive → block diffusion adaptation With the same GPU hours, models trained with CSBP score higher on SWE-bench Verified and Terminal-Bench Lite 👑 Open-sourced in Turbo-dLLM, our new optimized distributed training library. Advised by @Azaliamirh and with an amazing team: @PranshuChatur11 @hangoo_kang @pshroff_ @ishanskhare @KumbongHermann 🔗 View Quoted Tweet📊 3 ⚡

本条情报归属 AITOP「模型」核心栏目，重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中，该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」「中美大模型技术代差与商业化对照」研究主线，反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括：Context-Sharded Block Parallelism、扩散模型、并行策略、训练效率，读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明：本文原始线索采编自「Stanford AI Lab」（@StanfordAILab），经 AITOP 多维评分管线结构化提炼。