FIT-GGUF 为 MiniCPM5-2B 带来可控体积的混合精度量化

用户可以设定目标文件体积或保真度等级，工具会自动为不同张量分配精度，再预测、生成并校验最终 GGUF 文件。本次共发布 4 个版本，体积从约 1.

14 GiB 到约 1.46 GiB，并提供 Quality、Balanced、Compact、Mini 四种预设。

评测采用 KL Divergence 和 Same-top 指标，生成文件的体积与预测目标一致。这种方式让模型适配不同内存和部署条件，不必再局限于单一的 Q4/Q5 量化预设。

🚀 FIT-GGUF brings controllable-size mixed-precision quantization to MiniCPM5-2B Developer @Scorp1o_117 used FIT-GGUF to build MiniCPM5-2B GGUF variants around specific size and quality targets. Instead of choosing a fixed quantization preset, you can set a target file size or fidelity tier, and FIT-GGUF automatically decides how much precision to allocate to different tensors—then predicts, generates, and verifies the final GGUF.

✨ What’s included 🧠 Tensor-level mixed-precision quantization 📦 Four MiniCPM5-2B builds from ~1.14 GiB to ~1.46 GiB 🎯 Quality / Balanced / Compact / Mini presets 📊 KL Divergence and Same-top evaluation ✅ Generated file sizes matched the predicted targets

A nice example of how MiniCPM5-2B can be tuned for different memory and deployment constraints, without being locked into a single Q4/Q5-style quantization preset.

Check out FIT-GGUF and try building a MiniCPM5-2B variant that fits your own device budget.

🤗Model: https://t.co/WL3o7jLA1M https://t.co/FZOMTZh3tS

本条情报归属 AITOP「产品」核心栏目，重点聚焦中国 AI 产业与国产大模型生态。在跨区域产业观察坐标中，该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线，反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括：MiniCPM5-2B、FIT-GGUF、GGUF、量化，读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明：本文原始线索采编自「OpenBMB」（@OpenBMB），经 AITOP 多维评分管线结构化提炼。