CA-HNM:用结构化领域模型做约束感知的困难负样本挖掘
CA-HNM: Constraint-Aware Hard Negative Mining for Dense Retrieval with Structured Domain Models
一篇检索论文:训练双编码器时,用领域规则挑负样本,比单纯靠相似度排序挑效果更好,MOOCCubeX 上 8 个配置赢了 6 个。
论文提出 CA-HNM 框架,在稠密检索的负样本挖掘中加入来自结构化领域模型的确定性不相容规则,而不是只依赖检索相似度。方法流程包括剔除已知正例、构建查询目标的局部类型化上下文、记录关系/范围/目标/层级四类错配,再用这些样本微调标准双编码器。在 MOOCCubeX 和 Course-Skill Atlas 两个数据集上,用 2 种编码器、2 种训练损失、10 个随机种子评估,CA-HNM-Pure 在 8 个配置中的 6 个取得更高的平均 NDCG@10。结构信息只需在离线负样本构建阶段使用,在线推理无需额外开销。
CA-HNM: Constraint-Aware Hard Negative Mining for Dense Retrieval with Structured Domain Models
Dense retrievers are commonly trained with hard negatives selected from lexical or dense retrieval results. Retrieval proximity, however, does not indicate whether a candidate conflicts with explicit domain structure. We introduce CA-HNM, a constraint-aware hard-negative mining framework that combines retrieval-based candidate generation with deterministic incompatibility rules derived from a structured domain model. The framework removes known positives, constructs a local typed context around the query target, records relational, scope, target, and level mismatches, and uses the resulting candidates to fine-tune a standard dual encoder. Structured information is required only during offline negative construction. We evaluate CA-HNM on MOOCCubeX and Course-Skill Atlas with two encoders, two training losses, and ten seeds. Relative to a retrieval-rank-matched control, CA-HNM-Pure has higher mean NDCG@10 in six of eight dataset--encoder--loss configurations. Four hierarchical 95% bootstrap intervals are entirely above zero, mostly under triplet loss. In a separate experiment, CA-HNM-Mixed shows slightly higher mean NDCG@10 than a matched-mixed control on both collections. Structural variants show that changes in available structure can also change candidate eligibility and negative-pool composition. The results indicate that the contribution of constraint-aware selection depends on the training objective and the composition of the negative pool.