产品83°

Volantis获9700万美元融资

精选理由

这家初创公司用光技术突破AI芯片内存限制,让10T参数模型处理速度提升60倍。

Volantis公司通过光互连技术实现每秒10,000 token的处理速度。该公司已获得9700万美元融资,Sam Altman和Jeff Dean等知名人士参与投资。Volantis的光波导技术比光纤小2500倍,能将220个内存芯片连接成共享池。

原文 · rohanpaul_ai

This team is working to bring a MASSIVE 10,000 tokens/second/user on models above 10T parameters.

Volantis wants to cut coding-agent runs from 30 minutes to 30 seconds by feeding AI chips memory over light.

Sam Altman, Jeff Dean and John Doerr are among the backers of the $97M it has raised so far.

A single HBM memory stack is about 11mm long, longer than copper can reach. That limit is why Nvidia's best GPUs fit only 8 stacks each. Volantis uses light to wire over 220 memory chips into a single shared pool.

Volantis builds its optical waveguides directly into the chip package instead of using fiber cables. Each waveguide is over 2500x smaller than optical fiber. That density packs tens of thousands of light channels into the package.

Volantis claims well under 1 picojoule per bit, under 5ns latency and over 200TB/s in total.

Today's AI chips force a choice between memory capacity and memory speed. SRAM moves data very fast but holds too little to fit giant models, while HBM holds far more but moves data slower, which caps tokens per second.

But Volantis is connecting hundreds of memory chips over light, and their bandwidth adds up as each joins. So Capacity and speed grow together here.