论文

SAAF 框架实现高效零样本视频异常检测,XD-Violence 达 92.07% AUC

Efficient Zero-Shot Video Anomaly Detection via Signal-Aware Adaptive Fusion (SAAF)

精选理由

一个不用训练就能做视频异常检测的框架 SAAF,比之前的零样本方法快两倍多,还能超过监督模型,代码已开源。

论文提出 SAAF 框架,用双信号自适应采样器在语义嵌入空间中选择异常帧:delta 信号通过帧间余弦距离捕捉突变事件,drift 信号通过偏离滚动时间上下文检测渐变异常。其级联架构先做轻量帧级评分,仅在置信度不足时才调用昂贵的视频级时间分析。在四个基准上,SAAF 在 XD-Violence(92.07%)、MSAD(86.70%)、ShanghaiTech(80.54%)的 AUC-ROC 创训练无关零样本方法新纪录,其中 XD-Violence 和 MSAD 超过监督基线。吞吐量达 44.95 至 48.61 FPS,较此前最佳零样本方法提升 2.22 至 2.63 倍。

原文 · arXiv cs.AI

Efficient Zero-Shot Video Anomaly Detection via Signal-Aware Adaptive Fusion (SAAF)

Deploying Vision-Language Models for video anomaly detection confronts a fundamental constraint. Their semantic reasoning demands computational budgets incompatible with the scale of real-world video streams. We present Signal-Aware Adaptive Fusion (SAAF), a framework that achieves efficient zero-shot anomaly detection through three key innovations. First, we introduce a dual-signal adaptive sampler operating in semantic embedding space: a delta signal captures sudden events via frame-to-frame cosine distance, while a drift signal detects static and gradual anomalies through deviation from rolling temporal context. Their OR-gated combination with adaptive EMA-based thresholding provides comprehensive anomaly coverage without training data. Second, we propose a threshold-gated cascaded architecture where lightweight frame-level scoring precedes expensive video-level temporal analysis, invoking it only when confidence warrants additional context. Third, we design a signal-aware weighted fusion mechanism that dynamically adapts score combination based on which signal triggered frame selection. Across four benchmarks, SAAF delivers competitive accuracy at substantially lower cost. Among training-free zero-shot methods, SAAF sets a new state of the art on XD-Violence (92.07%), MSAD (86.70%), and ShanghaiTech (80.54%) AUC-ROC, with XD-Violence and MSAD also surpassing supervised baselines. SAAF sustains 44.95, 48.61, and 41.06 FPS on XD-Violence, UCF-Crime, and MSAD, a 2.43$\times$, 2.63$\times$, and 2.22$\times$ throughput improvement over the prior best zero-shot method. Code: https://github.com/kdawoud91/SAAF