模型精选

SlipSense 多模态触觉学习实现低延迟通用滑移检测

SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detection

精选理由

这个新框架 Slipsense 很实用,用两种传感器数据做滑移检测,比单独用一种更准,延迟还低,还能跨不同机器手和物体用,挺有意思的。

SlipSense 是一个基于 TacV5 传感器的多模态滑移检测框架,通过 32x32 压阻阵列和 3 轴 MEMS 加速度计捕捉压力分布和摩擦振动,在 240Hz 频率下进行模态编码、传感器内融合和跨模态注意力计算。

正文

在包含 1.4 百万帧、37 个物体的数据集上,它实现了 96.

7% 的 Macro F1 分数,在 23.1ms 内检测到 76% 的滑移事件,且仅用 UMI 数据训练就能零样本迁移到 Tesollo 机器手。

原文 · arXiv cs.AI

SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detection

Slip detection is fundamental to dexterous manipulation, yet existing systems often lack precise characterization of detection latency and cross-platform generalization. We present SlipSense, a multimodal tactile slip-detection framework built on TacV5, a compact sensor integrating a $32 \times 32$ piezoresistive array operating at 240 Hz and a 3-axis MEMS accelerometer operating at 8 kHz. The piezoresistive array captures spatial pressure distributions, while the accelerometer captures friction-induced vibrations, providing complementary slip cues. The framework performs modality-specific encoding, intra-sensor fusion, and cross-modal attention with causal temporal prediction at 240 Hz. Experiments on a dataset of 1.4 million frames spanning 37 objects demonstrate the complementarity of the two modalities. SlipSense achieves 96.7% Macro F1 with a false-positive rate below 1.6%, detecting 76% of slip events within 23.1 ms. When trained solely on UMI data, SlipSense generalizes zero-shot to a Tesollo dexterous hand, transferring across unseen objects, distinct sensor units, and robotic platforms without retraining.

产业坐标与信源核验

本条情报归属 AITOP「模型」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」「中美大模型技术代差与商业化对照」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:SlipSense、TacV5、滑移检测、多模态,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.AI」(@Tong Jian, Aditya Thurvas Senthil Kumar, Xinyi Li, Ziling Chen, Tianyu Dai, Ali Sengul, Matteo Grimaldi, Wenjie Lu, Saleh Nabi, Tao Yu),经 AITOP 多维评分管线结构化提炼。