模型

DeepSeek 开源 DeepInfer 推理引擎,支撑 V4.1-Flash 降本提速

Deepseek open-sources the inference engine that powers its fastest and cheapest AI model

精选理由

DeepSeek 把跑 V4.1-Flash 的推理引擎 DeepInfer 开源了,基于 vLLM,想自建部署省算力成本的可以拿来直接用。

DeepSeek 宣布开源 DeepInfer,这是驱动 V4.1-Flash 模型的推理框架,基于 vLLM 构建。该系统能在运行 AI 模型时降低计算成本与能耗。开源之后,其他开发者可以直接复用这套引擎来部署自己的模型。这一举动进一步压缩 OpenAI、Anthropic 等西方厂商在推理成本上的优势。

原文 · Decoder

Deepseek open-sources the inference engine that powers its fastest and cheapest AI model

Deepseek is open-sourcing DeepInfer, the inference framework behind its fast V4.1-Flash model. The vLLM-based system cuts compute costs and energy use when running AI models. The release adds more pricing pressure on Western providers like OpenAI and Anthropic. The article Deepseek open-sources the inference engine that powers its fastest and cheapest AI model appeared first on The Decoder .

DeepSeek 开源 DeepInfer 推理引擎,支撑 V4.1-Flash 降本提速|AI热报