NVIDIA HGX Rubin NVL8 将登陆 CoreWeave 云平台
CoreWeave 本季度要上 NVIDIA 的 Rubin NVL8 了,HBM4 能装下百万 token 上下文,跑智能体的吞吐是 B200 的 10 倍,做 Agent 服务可以盯一下。
CoreWeave 宣布 NVIDIA HGX Rubin NVL8 将在本季度上线其云平台。该平台配备 HBM4 显存,可容纳百万 token 级上下文的 KV 缓存,单节点能同时维持多个智能体会话。第六代 NVLink 将张量并行服务保留在节点内部完成。NVIDIA 预计其每兆瓦 token 吞吐量最高可达 HGX B200 的 10 倍。
The @NVIDIA HGX Rubin NVL8 is coming to CoreWeave Cloud this quarter, and it's built for agents with a lot to remember 🧠
Its HBM4 holds large KV caches for million-token contexts, so many agent sessions stay live at once on a single node.
Sixth-generation NVLink keeps tensor-parallel serving inside the node, and NVIDIA projects up to 10x more tokens per megawatt than HGX B200. https://t.co/VNnVLmFJAK