论文

基于CLIP的少样本学习用于Phase-OTDR振动事件分类

Vision-Language Model-Based Phase-OTDR Event Classification

精选理由

光纤振动传感的事件识别以前得靠海量标注,这篇把信号转成频谱图喂给CLIP,96张标注图就能到90%准确率。做传感、工业监测或想了解CLIP少样本迁移玩法的人都该看看,代码和数据都开源了。

一项发表于arXiv的研究将视觉语言模型引入Phase-OTDR分布式光纤振动传感的事件分类任务。研究把原始传感信号转成STFT dB幅度频谱图并映射为RGB图像,用CLIP图像编码器处理,通过Tip-Adapter-F进行少样本适配,只优化缓存键值,两个编码器完全冻结。

正文

在防泄漏协议下(每类512张支持/验证图、每类120张固定测试图、20次独立采样试验),ViT-L-14编码器配合每类128个样本达到96.81±0.42%准确率和96.79±0.42%宏平均F1;仅用每类16个样本(六类共96张标注图)也能达到90.17±0.81%。实验显示Tip-Adapter-F明显优于zero-shot CLIP和标准Tip-Adapter,且性能对提示词措辞不敏感、在不同ViT骨干间保持稳定。

传统Phase-OTDR事件分类依赖全监督模型,需要大量标注数据,该方法用轻量支持缓存即可实现标签高效的分类器,对光纤周界安防等部署场景降低了标注成本。代码和数据集已在GitHub开源。

原文 · arXiv: OpenAI

Vision-Language Model-Based Phase-OTDR Event Classification

Phase-sensitive optical time-domain reflectometry (Phase-OTDR) enables distributed vibration sensing, but reliable event classification has traditionally relied on fully supervised models that require extensive annotated data. This study examines the adaptability of a Vision-Language Model (VLM) for Phase-OTDR event recognition through few-shot learning. Raw samples are converted into Short-Time Fourier Transform (STFT) dB-magnitude spectrogram mosaics, color-mapped and resized to RGB images, and processed by a Contrastive Language-Image Pre-training (CLIP) image encoder; few-shot adaptation optimizes only the Tip-Adapter-F cache keys, leaving both encoders unchanged. Under a leakage-controlled protocol (train-side support/validation pool of 512 images per class, fixed held-out test of 120 per class, no test-set access during selection, 20 distinct support-sampling trials), the selected configuration (the ViT-L-14 Vision Transformer encoder with OpenAI weights, 128 shots per class) reaches 96.81 +/- 0.42% accuracy and a macro-averaged F1 score of 96.79 +/- 0.42% on the held-out test set; a label-efficient 16-shot setting, that is, 96 labeled support images at adaptation time across the six classes, already attains 90.17 +/- 0.81%. Tip-Adapter-F clearly outperforms both zero-shot CLIP and the standard training-free Tip-Adapter, and prompt and backbone analyses show that performance is stable across Vision Transformer encoders and insensitive to prompt wording at the selected operating point. Overall, CLIP visual features carry a transferable structure that a lightweight support cache turns into a label-efficient Phase-OTDR event classifier. The code and the corresponding image dataset are made publicly available on GitHub to support further research: https://github.com/miralab-ai/vlm-phase-otdr.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心追踪栏目。涉及核心实体与技术议题包括:CLIP、Phase-OTDR、少样本学习、Tip-Adapter,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始信息发布自一手权威信源「arXiv: OpenAI」(Tier-1 一手发布),具备高确定性参考价值。