LADA 用不到5%语言标注训练自动驾驶VLA,Bench2Drive 得分 87.98
Less Language, More Latents: Annotation-Efficient VLAs for Driving
Wayve 这篇论文教你怎么用不到5%的语言标注训出能开车的VLA,Bench2Drive 上分数还超过全监督基线,做自动驾驶的值得看看方法细节。
VLA 模型训练通常受限于自然语言指令标注稀缺。论文提出 LADA 三阶段流程:先用向量量化瓶颈训练潜在动作模型,压缩出高层驾驶意图码本;再用少量语言标注训练视觉-语言翻译器;最后在全量无标注数据上训练驾驶 VLA。仅用不到 5% 的语言标注、不用思维链或视觉问答数据,LADA 在 Bench2Drive 闭环基准上取得 87.98 的 Driving Score 和 70.46% 的成功率,达到或超过全监督基线。
Less Language, More Latents: Annotation-Efficient VLAs for Driving
Vision-language-action models (VLA) promise human-steerable autonomous driving, but their training is bottlenecked by the scarcity of frames paired with natural-language instructions: while camera streams and expert trajectories are logged at scale, language annotations (e.g., turn left at the intersection) remain scarce and expensive to acquire. To address this challenge, we introduce Latent Action Driving Annotations (LADA), a three-stage pipeline that transforms abundant unlabelled observation-trajectory pairs into a substrate for language-conditioned control. First, we train a latent action model with a vector-quantised bottleneck, producing a compact codebook of high-level vehicle intents. Second, a small language-annotated subset is used to train a vision-language translator to map observations and language instructions into this codebook. Third, we train a driving VLA on observation-latent-action pairs over the full unlabelled corpus. Using fewer than 5% of language annotations and without leveraging any auxiliary chain-of-thought reasoning or visual question answering streams, LADA achieves a Driving Score of 87.98 and a Success Rate of 70.46% on the closed-loop Bench2Drive benchmark, matching or surpassing fully supervised baselines.