模型精选

Nature Will 发布 Natura-1:用 100 万小时人类第一视角视频训练机器人双手

精选理由

机器人公司 Nature Will 用 100 万小时人类手部视频训练出 Natura-1,直接控制真实机器人手,还支持零训练学新任务,和只演示单一技能的方案不太一样。

Nature Will 训练了机器人基础模型 Natura-1,数据来自 100 万小时人类第一视角手部操作视频,用于控制真实机器人手。相比采集缓慢的机器人演示数据,人类视频是更快的规模化路径。该模型同时覆盖三项能力:抓取后的双手精细控制、无需额外训练执行新任务,以及跨长序列记忆步骤并从错误中恢复。多数机器人系统只能在狭窄场景中展示其中一项。

原文 · rohanpaul_ai

The hardest thing to give a robot is a capable pair of hands, and Natura-1, from @naturewill is a strong attempt at it.

Nature Will trained their new Natura-1 on 1M hours of egocentric human data

first-person video of people using their hands, then used that to control real robot hands

Robot demonstrations are slow to collect, so human footage is the faster route to scale, provided the skills survive the move from human hands to robot hands.

One model handles 3 things robots usually fail at together: fine 2-handed control after the grasp, new tasks without extra training, and long sequences where it has to remember earlier steps and recover from mistakes. Many robot systems show 1 of these in a narrow setting.

https://t.co/rQViEBIDD8