产品精选

PyTorchCon将介绍DeepSpeed新并行技术

精选理由

PyTorchCon将揭秘DeepSpeed超越ZeRO的新并行技术,看看AutoTP、AutoSP和AutoEP如何提升训练效率。

PyTorchCon北美2026会议将展示DeepSpeed的AutoTP、AutoSP和AutoEP并行技术。Masahiro Tanaka将讲解张量、序列和专家并行技术及其基准测试结果。这些技术可与ZeRO结合使用,提供类似易用性。会议将于2026年举行,现已开放注册。

原文 · PyTorch

Think DeepSpeed is only good for ZeRO and its usability, not training throughput?

At #PyTorchCon North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks.

His session, “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability,” will cover AutoTP, AutoSP, and AutoEP, how these capabilities can be combined with ZeRO, and where each parallelism strategy fits.

Register for PyTorch Conference North America 2026: https://t.co/jBApW8nESi