Traffic-VL:80亿参数视觉语言模型实现端到端交通信号控制
Traffic-VL: Reinforced Vision-Language Models for Generalizable End-to-End Traffic Signal Control
研究者把仿真画面变成逼真监控图像来训练 8B 视觉语言模型直接控红绿灯,实路口部署三周还跑赢了 Gemini 3 Pro,做法挺有意思。
Traffic-VL 是一个 80 亿参数的视觉语言模型,直接把多视角监控画面和自然语言相位描述映射为信号灯决策,跳过中间结构化状态。其配套的 SynTra-V 管线把物理交通仿真转成逼真多视角监控图像,并用自动语义审计保证几何与车辆运动一致。模型基于 Traffic-R1 的两阶段强化推理框架,先离线强化学习适配视觉编码器,再在闭环仿真中做在线视觉轨迹策略优化。实验显示它追平基于结构化状态的 Traffic-R1,超过 Gemini 3 Pro 等通用视觉语言模型,并在十个路口实际部署三周验证了效果。
Traffic-VL: Reinforced Vision-Language Models for Generalizable End-to-End Traffic Signal Control
Existing traffic signal control methods typically rely on structured traffic states produced by dedicated perception pipelines. Emerging visual approaches often use idealized simulator images and convert them into intermediate representations before control, limiting their ability to directly exploit roadside visual observations. To bridge both the visual-domain and perception-to-decision gaps, we introduce SynTra-V and Traffic-VL. SynTra-V converts physics-based traffic simulations into photorealistic multi-view surveillance imagery across diverse road topologies and sensing conditions, and automatic semantic auditing checks that control-critical geometry, vehicle movements, and lane semantics match the simulator state. Traffic-VL is an eight-billion-parameter vision-language model that directly maps synchronized multi-view images and natural-language phase descriptions to signal decisions without intermediate structured states. Building on Traffic-R1's two-stage reinforced reasoning framework, Traffic-VL adapts its vision encoder via offline reinforcement learning on SynTra-V and freezes it during online visual stepwise trajectory policy optimization in closed-loop simulation. Experiments show that Traffic-VL matches structured-state Traffic-R1 while outperforming image-based controllers and general-purpose vision-language models, including Gemini 3 Pro. Evaluations on unseen topologies, degraded sensing conditions, real surveillance footage, and a three-week deployment across ten intersections further demonstrate robust visual generalization and effective constrained online control.