论文多源确认精选73°

AI与HPC交叉的模板计算研究

Stencil Computation at the Intersection of AI and HPC

精选理由

TinyTC团队展示了AI编译器如何优化HPC模板计算,在Intel GPU上性能领先,PyTorch/Triton则提供跨厂商开发基准。

TinyTC和OpenAI Triton等张量编译器最初为AI工作负载开发,但相同的平铺和内存抽象可应用于实现科学和工业应用的高效高阶模板。研究团队实现了8阶25点声学模板,在GPGPUs上比较TinyTC与PyTorch/Triton实现。在Battlemage B580上,TinyTC达到15.6 Gpts/s,而PyTorch/Triton为13.5 Gpts/s。零初始化运行因硬件内存压缩可达35.8 Gpts/s。

原文 · arXiv: OpenAI

Stencil Computation at the Intersection of AI and HPC

Tensor compilers such as TinyTC and OpenAI Triton were originally developed for AI workloads, but the same tiling and memory abstractions can be applied to implement efficient high-order stencils for scientific and industrial applications. We demonstrate this for an 8th-order, 25-point acoustic stencil with boundary conditions over an a demanding-sized grid, targeting GPGPUs, where we compare the hardware-specialized TinyTC implementation with a portable PyTorch/Triton implementation. The target platforms for evaluation include Intel B70, B580, GPU MAX 1550, NVIDIA A100/RTX6000 Blackwell/H100, and AMD MI325x. For instance, on Battlemage B580 TinyTC reaches 15.6 Gpts/s versus 13.5 Gpts/s for PT/Triton under random initialization, while zero-initialized runs reach up to 35.8 Gpts/s due to hardware memory compression. Using roofline and memory-hierarchy profiling, we show that -as expected- performance is predominantly bandwidth-limited and that compiler-managed L1/LSC caching can effectively replace programmer-managed shared-memory staging for this stencil class. Overall, the results position TinyTC as the performance-oriented path on Intel hardware and PyTorch/Triton as a strong portability/productivity baseline for cross-vendor HPC stencil development.