论文

基于通用语义增强的表格数据弱监督异常检测方法

Universal Semantic Enhancement for Weakly Supervised Anomaly Detection

精选理由

只给你 8 个标注异常样本也能做表格异常检测,方法是把预训练表格基础模型的通用知识和自己数据集的特征融合,实验跑赢了现有方法。

一篇 arXiv 论文针对表格数据弱监督异常检测任务:现实中往往只有极少量标注异常样本和大量无标注数据,现有方法容易过拟合稀缺标签。作者提出融合预训练表格基础模型的通用知识与目标数据集的领域特定知识,两种特征天然互补。论文设计了原型条件调制机制来整合两类特征。在公开数据集上的实验显示,仅有 8 个标注异常样本时,该方法优于竞争方法。

原文 · arXiv cs.LG

Universal Semantic Enhancement for Weakly Supervised Anomaly Detection

Weakly supervised anomaly detection on tabular data is an essential task in many label-scarce applications, since tabular data is widely encountered and it is commonly observed in practice that only a limited number of labeled anomalies are available alongside abundant unlabeled samples. Most existing methods try to learn features that capture the inherent distribution patterns in the target domain. However, such features often struggle to provide a complete description of possible abnormal characteristics and are highly susceptible to overfitting the extremely scarce labels. To address this challenge, we propose a weakly supervised anomaly detection method based on universal semantic enhancement for tabular data, which fuses the universal knowledge from a pre-trained tabular foundation model with the domain-specific knowledge learned on the target dataset. The two types of knowledge are naturally complementary: universal semantics describe the common patterns of tabular data across domains, while the domain-specific features capture the inherent distributions of normal and anomalous behaviors in the target dataset. A prototype-conditioned modulation mechanism is then designed to effectively integrate the two types of features, allowing them to reinforce each other for improved anomaly detection. Extensive experiments on public datasets show that the proposed method outperforms competitive methods when only eight labeled anomalies are available in the training procedure.