论文

QA-CMIF:跨模态填补融合方法提升sEMG惯性手势识别的容错能力

QA-CMIF:Accurate and Lightweight Cross-Modal Latent Imputation and Fusion for Fault-Tolerant sEMG-Inertial Hand Gesture Recognition

精选理由

做肌电假肢或可穿戴交互的团队可以看看这篇:QA-CMIF在电极坏掉一半的情况下还能保持识别精度,而且参数量不到0.2M、CPU延迟1.44ms,比传统融合网络轻很多,边缘设备上跑得动。

论文提出QA-CMIF,一个面向sEMG与惯性测量融合手势识别的质量感知跨模态潜空间填补框架,针对日常佩戴中电极脱落、导线断裂等导致的通道损坏问题。该框架对每个sEMG通道独立编码,用软门控评估可靠性,通过置信度加权残差旁路保护完好通道,并利用惯性流和剩余可靠sEMG通道,在坏通道对齐损失约束下用跨注意力机制在潜空间修复受损通道。

正文

在Ninapro DB3、DB2、DB5共29名参与者、17-52类手势的个体内评估中,QA-CMIF在50%通道损坏下比仅门控基线在三个17类任务上高出1.29-2.65个百分点(配对t检验Holm校正p<0.002),在40和52类任务上扩大到2.59-4.15个百分点,比带损坏增强的传统融合高出4.61-19.85个百分点。

模型仅0.175-0.185M参数、2.45-2.63M乘累加运算,2000Hz和200Hz设置下相比近期基线节省46%-55%参数和72%-81%计算量,单线程CPU 99分位延迟1.44ms,适合肌电假肢控制等低功耗可穿戴场景部署。

原文 · arXiv cs.LG

QA-CMIF:Accurate and Lightweight Cross-Modal Latent Imputation and Fusion for Fault-Tolerant sEMG-Inertial Hand Gesture Recognition

Fusing surface electromyography (sEMG) with inertial measurements is widely used for myoelectric prosthesis control and wearable human-machine interfaces. In daily wear, however, socket micro-displacement, electrode lift-off, and wire failures often corrupt an unknown subset of sEMG channels through burst artifacts, lift-off shocks, or open-circuit dropouts. Existing fusion networks mix all channels in the first convolutional layer, so a few corrupted electrodes contaminate the entire latent representation, whereas gate-only attenuation of corrupted channels discards the co-activation cues needed to separate fine-grained gestures. We propose QA-CMIF, a quality-aware cross-modal latent imputation and fusion framework that encodes each sEMG channel independently, scores its reliability with a soft gate, and protects intact channels via a confidence-weighted residual bypass, while a cross-attention imputer repairs degraded channels in latent space using the inertial stream and remaining reliable sEMG channels under a bad-channel alignment loss. Across within-subject evaluations on 29 participants from Ninapro DB3, DB2, and DB5 spanning 17-52 gesture classes, QA-CMIF outperformed the gate-only baseline under 50% channel corruption by 1.29-2.65 percentage points, denoted pp, across all three 17-class cohorts with paired-t Holm-adjusted p<0.002, widened this margin to 2.59-4.15 pp on the 40- and 52-class tasks, and surpassed corruption-augmented conventional fusion by 4.61-19.85 pp. Requiring only 0.175-0.185M parameters and 2.45-2.63M multiply-accumulate operations across the 2000 Hz and 200 Hz setups, QA-CMIF saves 46%-55% in parameters and 72%-81% in compute over recent baselines with a 1.44 ms 99th-percentile single-thread CPU latency.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心追踪栏目。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:sEMG、手势识别、多模态、跨注意力,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.LG」(@Xinyu Tao, Shuang Huang, Yeyun Cai, Fang Deng),经 AITOP 多维评分管线结构化提炼。