模型

机器人操作模型从人类视频学习技能,零样本完成 60 项任务

精选理由

机器人学操作不用再花钱采机器人演示数据了,直接从人类视频学,60 项任务零样本跑,长时程任务成功率还只有 10.5%,成绩很诚实。

这款模型让机器人通过人类数据学习操作技能,省去了专门采集机器人演示数据的成本。测试覆盖 60 项任务、600 次试验,无需针对具体任务训练机器人演示。在拾取放置类任务上成功率为 63.5%,其他操作任务为 34.0%,最具挑战的长时程任务成功率为 10.5%。

原文 · Ate-a-Pi

This model helps robots learn to manipulate objects physically.

But there's something really interesting about it:

The model learns skills from humans rather than relying on robot demonstrations, which are much more expensive and time-consuming.

Basically, this model lets robots perform zero-shot tasks without training on robot demonstrations collected specifically for those tasks.

They demonstrated this:

• 60 tasks and 600 trials • 63.5% success on pick-and-place tasks • 34.0% success on other manipulation tasks • 10.5% success on challenging/long-horizon tasks