论文

SE(3) 神经势场:无需 3D 重建,直接从图像规划 6-DoF 抓取轨迹

SE(3) Neural Potential Fields for 6-DoF Trajectory Planning Directly from Images Without Explicit 3D Reconstruction

精选理由

机械臂规划的新论文:跳过 3D 重建,直接从 RGB 图像学势场做 6-DoF 轨迹规划,UR10 上全起点零碰撞。

论文提出 SE(3) 神经势场,从带位姿的 RGB 图像学习,训练时用同一批图像恢复的自由空间测地距离作导航函数监督,避免传统人工势场中梯度抵消导致的擦碰与停滞。在两个桌面抓取场景的 UR10 实验中,从所有起点均收敛到抓取位姿 3 cm 以内,对真值几何保持零碰撞,仅用图像监督的基线为 25% 和 0%。平均间隙从不到 1 cm 提升到 8.6-8.8 cm,臂身碰撞构型占比从 20.6-50.4% 降到 2.7-5.5%,抓取成功率为 90.0% 与 40.0%。规划耗时约 2 s,快于在同一图像重建上跑 RRT* 的 67-133 s,作者同时指出统一离线测试下两者相当,差距来自碰撞检查密集重建的开销。

原文 · arXiv cs.AI

SE(3) Neural Potential Fields for 6-DoF Trajectory Planning Directly from Images Without Explicit 3D Reconstruction

Reaching a 6-DoF grasp pose in clutter requires a collision-free trajectory, conventionally obtained by reconstructing the scene in 3D and planning inside that reconstruction, at the cost of its accuracy and compute. Potential fields learned directly from images remove that dependency but inherit the classical weakness of artificial potential fields: where attractive and repulsive gradients cancel, the descent grazes the obstacle instead of going around it, and can stall short of the goal. We present an SE(3) neural potential field learned from posed RGB images and supervised with a navigation function, the geodesic distance to the grasp through free space recovered from those same images during training, which removes both failures. On two tabletop scenes, from obstacle-blocked starts executed on a UR10, the field converges within 3 cm of the grasp from every start and every path it executes is collision-free against the ground-truth geometry, against 25% and 0% under image supervision alone; mean clearance rises from under a centimeter to 8.6-8.8 cm and arm-link contacts fall from 20.6-50.4% to 2.7-5.5% of executed configurations. Executed grasp success is 90.0% and 40.0% on the two scenes, the residual failures being refusals of the Cartesian executor rather than of the field. Planning takes about 2 s against 67-133 s for RRT* on a reconstruction of the same images, though under a common offline harness the two are comparable: the deployed margin is the cost of collision-checking a dense reconstruction, not planner complexity.