论文

神经 HJ 安全证书的枚举引导训练方法

Enumeration-Guided Training of Neural Hamilton-Jacobi Safety Certificates

精选理由

训练安全的神经网络控制器一直很难,这篇用枚举反例微调证书,在真实赛车上做到零违例,做控制安全方向的可以细看。

Hamilton-Jacobi 可达性分析可为控制系统提供形式化安全保证,但训练准确的神经证书难度较大。该工作提出验证引导的训练框架,用安全约束的概率枚举检测前向不变性违例,生成比标准对抗攻击更精确刻画失败边界的反例集。用这批反例微调预训练 HJ 值函数后,在所有测试基准上认证区域更大、认证时间更短。基于精炼证书的屏蔽机制在 Isaac Sim 物理仿真和真实自动驾驶赛车实验中实现零安全约束违例,优于标称控制器和基于 LQR 的备份策略。

原文 · arXiv cs.LG

Enumeration-Guided Training of Neural Hamilton-Jacobi Safety Certificates

Hamilton-Jacobi (HJ) reachability analysis offers formal safety guarantees for control systems, but training accurate neural certificates remains difficult, particularly when unsafe regions are hard to characterize. We propose a verification-guided training framework that addresses this by using probabilistic enumeration of safety constraints to detect forward-invariance violations, i.e., states where the learned certificate incorrectly classifies unsafe behavior. This produces a compact, targeted set of counterexamples that more precisely captures the failure boundary than inputs generated by standard adversarial attack methods. Crucially, using this representation to fine-tune a pretrained HJ value function yields larger certified regions and reduces certification time across all tested benchmarks. We further introduce a shielding mechanism based on the refined certificates to enforce safety constraints at deployment time. We evaluate the proposed safety filter in a realistic, physics-based Isaac Sim environment and through real-world autonomous racing experiments, achieving zero safety constraint violations compared to a nominal controller and a backup policy based on Linear Quadratic Regulation (LQR). These results demonstrate the effectiveness of the proposed shielding mechanism in ensuring safe operation under high-speed, safety-critical conditions.