Backtrack:让冻结 VLA 模型自主检测并回退恢复失败
If at First You Don't Succeed, Backtrack: Lightweight Recovery for Frozen VLAs
机器人 VLA 卡住不用重训,一个 0.48-0.88% 参数的小头就能让 π0-FAST 它们在 LIBERO-Long 上失败率降近一半,思路很巧。
Backtrack 是面向冻结 VLA 模型的轻量失败检测与恢复机制,无需恢复演示、重训或额外模型。它用一个只占参数量 0.48-0.88% 的失败预测头读取模型内部表示,预测当前回合是否将失败;超过阈值时暂停策略、倒转机械臂近期动作,再交还原策略从较早状态重试。在 LIBERO-Long 上,SmolVLA、π0.5 和自回归的 π0-FAST 三种模型的失败率降低 19-48%,成功率最多提升 7.4 个百分点。在 MetaWorld 上,用 SmolVLA 测试的 12 组控制器配置全部优于无辅助基线。
If at First You Don't Succeed, Backtrack: Lightweight Recovery for Frozen VLAs
Vision-Language-Action (VLA) models perform well on robotic manipulation, yet remain brittle once their own actions carry them into states their training data barely covers. Recovering from such failures usually requires recovery demonstrations, policy retraining, or a separate model at inference time. We introduce Backtrack, a lightweight failure detection and recovery mechanism for frozen VLAs that needs none of these. A small failure prediction head, trained only on outcome-labeled rollouts of the frozen policy, reads the VLA's existing internal representations to estimate whether the current episode will fail. When the predicted failure probability exceeds a threshold, a controller pauses the policy, retraces the arm's recently achieved motion, and hands control back to the unchanged policy so it can retry from an earlier configuration. The head adds only 0.48-0.88% to the policy's parameter count. We evaluate Backtrack on LIBERO with three VLAs spanning two action-generation families: SmolVLA and $π$0.5, which use flow-matching action experts, and the autoregressive $π$0-FAST. On LIBERO-Long, the suite of long-horizon multi-step tasks and the one on which all three policies fail most often, Backtrack reduces each policy's failure rate by 19-48%, raising success by up to 7.4 percentage points; on the three shorter suites, where control success is already 85-99%, its effect is smaller. On MetaWorld, all twelve controller configurations tested with SmolVLA improve on the unassisted policy.
- rohanpaul_ai10-22 05:56原文