产品

MiniCPM-V 4.7 35B-A3B 搭配 ESP32 屏幕做拍照记录热量的演示项目

精选理由

OpenBMB 社区用 MiniCPM-V 4.7 拍照识菜估热量,再让 ESP32 圆屏用进度环显示每天吃剩多少额度。流程拆得很细,识别结果要人工确认才入账。想玩视觉模型加硬件的可以照着搭。

OpenBMB 的 ambassador emwstudio 发布了 esp32-intake 演示项目,用 MiniCPM-V 4.7 35B-A3B 模型拍照识别食物并估算热量,配合 iOS 应用和 ESP32-S3 AMOLED 圆形屏幕使用。模型通过 ModelBest API 在线运行,ESP32 只负责本地显示。

正文

工作流程是:拍照后模型识别食物并给出热量估算,用户在加入每日总热量前可以确认、重新估算或跳过,还能预览这顿饭对当日目标的影响。应用把当天热量总数通过本地 Wi-Fi 发送到 ESP32-S3 屏幕,屏幕上用进度环、剩余热量数字和绿黄红三种状态颜色展示摄入情况。

热量估算为近似值,仅供一般参考。该项目代码开源,MiniCPM-V 模型也在 GitHub 和 Hugging Face 上开放,适合想动手把多模态模型接到硬件上的开发者参考。

原文 · OpenBMB

📸 Snap your meal. Review the estimate. See your daily intake at a glance.

Our ambassador @emwstudio built esp32-intake, a food-logging demo that connects MiniCPM-V’s visual understanding with an iOS app and a circular ESP32 display. 🍽️

Here’s the workflow: 🧠 MiniCPM-V 4.7 35B-A3B identifies food in a photo and estimates calories through the ModelBest API. ✅ You review the estimate before adding it to your daily calorie total. Re-estimate or skip it, with a preview of how the meal would affect your daily target. 📊 The app stores today’s calorie total locally and sends the total and daily target over the local Wi-Fi network to an ESP32-S3 AMOLED display. 🟢🟡🔴 A progress ring, calories remaining — or over target — and matching status colors make the day’s intake easy to check.

The model runs online via API; the ESP32 handles the display. Calorie estimates are approximate and intended for general reference.

We love seeing our ambassadors turn visual intelligence into hands-on experiences that connect software, hardware, and everyday routines. 💙

🛠️ Explore @emwstudio’s project: https://t.co/oIQp6fQCXV 🚀 MiniCPM-V GitHub: https://t.co/iYDxpa52tn 🤗 Model on Hugging Face: https://t.co/Lwu8eW4QbF

#MiniCPM #OpenBMB #ESP32 #OpenSource

产业坐标与信源核验

本条情报归属 AITOP「产品」核心栏目,重点聚焦中国 AI 产业与国产大模型生态。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:MiniCPM-V、OpenBMB、ESP32、多模态,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「OpenBMB」(@OpenBMB),经 AITOP 多维评分管线结构化提炼。