论文

手机摄像头+VR:一项研究用姿势估计和GPT-4o游戏化HIIT训练

Smartphone-Aided VR Exergames for HIIT: Gamifying Fitness with Real-Time Pose Estimation

精选理由

一篇用手机摄像头替代动捕服的论文,接 GPT-4o 和 MCP 给 HIIT 动作打分,跟教练评估一致率 87.5%,做法挺有意思。

arXiv 论文提出一套 VR 健身系统,用三脚架上的手机摄像头做全身动作捕捉,替代可穿戴动捕服,覆盖 11 组 HIIT 组合动作。视频经实时姿势估计提取生物力学数据,由基于 MCP 协议的后端和 GPT-4o 生成动作准确性、受伤风险等个性化评估。20 名 18-25 岁参与者的组内实验显示,VR 条件下乐趣(3.5 vs 2.8,p=0.02)和专注度(3.2 vs 2.8,p=0.03)显著更高。MCP 系统与一名认证教练的专家评估一致率达 87.5%(10 次训练)。

原文 · arXiv: Anthropic

Smartphone-Aided VR Exergames for HIIT: Gamifying Fitness with Real-Time Pose Estimation

This paper introduces an innovative virtual reality (VR) exergame system designed to gamify High-Intensity Interval Training (HIIT) workouts through 11 predefined combo moves, including squat-punch combinations, bilateral arm strikes, and diagonal stretch combos. Unlike conventional tracking methods that often rely on wearable motion capture suits or limited headset-based sensors, our system uses a standard smartphone camera placed on a tripod to capture full-body movement. This approach offers a cost-effective and scalable alternative, particularly well-suited to the fast, dynamic motions typical of HIIT routines. The smartphone footage is processed in real time using a pose estimation algorithm, with extracted biomechanical data analyzed by a backend server built on the Model Context Protocol (MCP), Anthropic's open standard for connecting AI models to structured data sources and tools, and a GPT-4o large language model. The system generates personalized assessments of form accuracy, movement efficiency, exercise intensity, and potential injury risks, tailored specifically to high-impact, time-sensitive exercises. A within-subject study involving 20 participants (ages 18-25) compared experiences in VR and Non-VR HIIT sessions. Results indicated significantly higher enjoyment (Mean = 3.5 vs 2.8, p = 0.02), improved immersion/focus (Mean = 3.2 vs 2.8, p = 0.03), and increased likelihood to recommend (Mean = 3.2 vs 2.7, p = 0.04) under the VR condition. Confidence to continue did not differ significantly between conditions (p = 0.15), while perceived intensity remained comparable. The MCP system showed strong agreement with expert evaluation (87.5%, N = 10 sessions, one certified trainer), supporting its reliability as a feedback tool.