基于状态空间模型的sEMG腕部肌电实时打字解码,字符错误率降至25.13%
Typing Matters: Muscle, Language and Typing Behaviour in Live Keystroke Decoding from sEMG
Meta系的sEMG打字研究这次换了个思路:用SSM把语言模型直接融进肌电解码,零前瞻实时出字,错误率还比前最优低5.4%、参数少6.7倍。做腕带输入设备或BCI解码的工程师会想细读,尤其那个把WikiText变成打字语料的retokenization方法。
一篇arXiv论文提出全因果、零前瞻的腕部sEMG打字解码器,在emg2qwerty跨用户基准上取得25.13%的字符错误率,相比此前最优结果相对降低5.4%,参数量减少6.7倍。作者认为以往把问题当作离线信号推断的框架丢掉了大部分难点:解码同时受肌肉信号、输入语言和打字行为(错字、退格、换行)约束,且必须在手持续移动时实时预测按键。
技术上是单一状态空间模型(SSM)处理整个会话,不做固定窗口切分,保留会话内累积上下文,并把传统打字解码器与自回归语言模型融合,让模型同时具备肌电和语言理解。训练侧引入retokenization方法,把WikiText改写成含按键、错字和退格的人类打字序列,生成此前不存在的逐字符打字语料。
模型在训练中从未见过任何sEMG到字符的打字转录,仍取得上述成绩,说明跨用户泛化主要靠语言结构先验而非个体肌电标注数据,这对可穿戴输入设备的落地成本有直接意义。
Typing Matters: Muscle, Language and Typing Behaviour in Live Keystroke Decoding from sEMG
Surface electromyography (sEMG) from the wrists can recover typed text without a keyboard. It is usually posed as a signal-inference problem: characters are read out of the muscle signal and character error rate is reported offline. We argue that this framing removes most of the problem. The decoder is constrained simultaneously by the muscles, by the language being typed, and by typing behaviour such as typos, corrections, backspaces and line breaks, and a usable system must predict keys live while the hand keeps moving. Existing systems fall short on two counts: (1) they process sEMG in fixed windows and carry nothing from one window to the next, discarding context accumulated over a session, and (2) they lack any understanding of the linguistic structure that drives typing, so every keystroke is inferred from the muscle signal alone. We propose a fully causal, zero-lookahead sEMG typing decoder built on a state space model (SSM), in which a single model decodes a whole session without windowed partitions, conditioned on what has already been typed. We achieve this by fusing a traditional typing decoder with an efficient autoregressive language model, instilling both sEMG and linguistic understanding in one model. To train such a model for per-character typing rather than whole-word text, we introduce a retokenization method that rewrites ordinary prose as human-like typing, with keystrokes, typos, backspaces and line breaks included, converting WikiText into a large typing corpus where none existed. Our model, having never seen a single sEMG-to-character transcript in typing, achieves a state-of-the-art character error rate of 25.13% on emg2qwerty's cross-user benchmark, a 5.4% relative improvement over the previous best with 6.7 times fewer parameters, while running strictly causally with no future context.
本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:sEMG、状态空间模型、emg2qwerty、肌电解码,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「arXiv cs.AI」(@Abhilash Durgam, Nyle Siddiqui, Mubarak Shah, Qiushi Fu),经 AITOP 多维评分管线结构化提炼。