Marvell 展示光子互连模块,内存可离 GPU 最远 50 米部署
Marvell 搞了个光子模块,内存能放到 50 米外离 GPU 部署,延迟才几百纳秒,AI 集群内存不用再焊死在加速器旁边了。
Marvell 的 Dave Lazovsky 展示了一款光子学模块,可将 HBM 和 DDR 高带宽内存从 GPU 旁迁移到最远 50 米外,而传统封装要求距离约 1.5 mm。延迟保持在数百纳秒量级,满足实际内存访问需求。这意味着内存和计算可以沿各自独立的维度扩展,AI 集群能够共享大规模内存容量,不再受限于加速器封装。
Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.
this can sit up to 50 meters from a GPU instead of the usual 1.5 mm.
For the first time, memory no longer has to live right next to compute, letting AI clusters share massive capacity without being locked to the accelerator package.
Latency stays in the hundreds of nanoseconds, close enough for practical memory use. Basically, Memory and compute now scale on separate axes instead of being locked together. https://t.co/jl7wyH9gfd