vLLM-Omni 发布 Day-0 支持新增 FLUX 3 Image Klein 图像生成
vLLM-Omni 发布当天就支持了 FLUX 3 Image Klein，BF16、FP8、NVFP4 格式都有，想自己部署图像生成的可以直接拉 Docker 镜像试。
vLLM 项目宣布 vLLM-Omni 在 FLUX 3 Image Klein 发布当天完成支持，由 Black Forest Labs 和 NVIDIA 协作完成。该集成提供 BF16、FP8 和 NVFP4 三种 checkpoint 格式。针对 transformer 和 text encoder 做了 custom kernel 优化，并支持 Hugging Face 模型路径处理。用户可通过 docker pull vllm/vllm-omni:flux-3-image-klein 拉取镜像部署。
🎉 Day-0 support for FLUX 3 Image Klein is here in vLLM-Omni!
We worked with Black Forest Labs and NVIDIA to bring the new image-model release to the vLLM-Omni serving stack.
What the integration brings: 🎨 FLUX 3 Image Klein image generation ⚡ BF16, FP8 and NVFP4 checkpoint formats 🛠️ Custom kernels, with optimizations across the transformer and text encoder 📦 Hugging Face model-path handling for the text encoder and autoencoder
Thanks to Black Forest Labs, NVIDIA and the vLLM-Omni community for the collaboration.
Docker image: docker pull vllm/vllm-omni:flux-3-image-klein
Explore vLLM-Omni: https://t.co/rt9AD6lE04
Deployment recipe: https://t.co/ynBDoHjZPy
