Perceptron AI:专用小模型标注机器人视频,成本降约 8 倍
Perceptron AI 实测发现标注机器人视频用专用小模型就够,比顶级大模型省 8 倍钱,质量几乎不打折,做机器人的可以看看。
Perceptron AI 的研究显示,在机器人训练视频标注任务上,为大模型多付约 8 倍费用几乎换不来更高的标注准确率。团队提供一个 API,输入第一人称做家务的视频,即可输出带时间戳的分步动作和每只手的动作。针对该任务专门构建的小系统每标注 1 小时视频的成本很低,质量与通用前沿模型接近。这使团队已有的视频素材可以被更多地用于训练。
So much brilliant work is happening on robot training.
A lot of the cost in robot learning sits in labeling video, step by step and hand by hand. If that cost can be reduced by about 8x at nearly the same quality, much more of the footage teams already have can be used.
And now we also have proof that specialized model harnesses are closing in on general frontier models for narrow video tasks, at a fraction of the cost.
Upload a first-person video of someone doing chores, and we have an API returns each step with timestamps, what each hand is doing.
Perceptron AI's research shows, For labeling robot training video, paying 8x more for the biggest AI model buys you almost no extra accuracy. A smaller system built only for this job gets the same result for the price of a sandwich per hour of video.
https://t.co/7Biz3tItwP