行业79°

微软发布自研芯片 Maia 300,每瓦 token 数比 GPU 系统高 40%

精选理由

微软官宣 Maia 300 自研芯片,能效比 GPU 系统高 40%,明年起要大规模铺开当主力推理硬件了。

Satya Nadella 宣布微软将扩大自研芯片 Maia 的部署规模,从下个日历年起扩展至多吉瓦级别,作为自家产品和服务的主要推理系统。新发布的 Maia 300 每瓦可处理的 token 数比领先 GPU 系统高 40%。Maia 200 目前已在美国、欧洲和澳大利亚部署,在 Teams 和 Copilot 的服务中实现最高 1.7 倍的每瓦 token 提升.Mustafa Suleyman 也转发了这一消息。

原文 · Mustafa Suleyman

Our new silicon is 🔥 40% more tokens per watt! Satya Nadella @satyanadella Today we are announcing our biggest bet yet on our own silicon. Starting next calendar year, we will scale our Maia family to multi-gigawatt deployments, making it the primary inference system for our own product and services. And we’re introducing Maia 300, which delivers 40% more tokens per watt compared to leading GPU-based systems. We are already deploying Maia 200 across the US, Europe, and Australia, delivering up to 1.7x more tokens per watt across experiences in Teams and Copilot. Our goal is to build on the full-stack efficiency gains we’ve already seen, while continuing to bring the latest innovations from across the ecosystem into our fleet. 🔗 View Quoted Tweet 💬 18 🔄 7 ❤️ 111 👀 4877 📊 19 ⚡