提出双分支学习框架 DualMLC 改进大规模多标签文本分类
LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification
学术研究分享,提出新方法,开源代码,对做文本分类的研究者可能有参考价值。
针对大规模多标签文本分类任务,提出 DualMLC 框架,通过同时使用自回归语言模型和双向编码器处理文本,分别计算标签相关性分数,再通过 late logit fusion 融合两个分支的分数。该框架在三个常用基准测试上取得 SOTA 成绩,并开源代码。
LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification
Large-scale multi-label text classification assigns a small subset of relevant labels to each document from a vocabulary containing thousands or tens of thousands of candidate labels. Although pretrained language models have improved semantic text representations, most representation-based approaches center their prediction pipelines on a primary encoder or combine auxiliary features within a single ranker. The complementarity between heterogeneous language models therefore remains insufficiently explored. We propose DualMLC, a dual-branch framework that processes the same document through an autoregressive decoder-only language model and a bidirectional encoder. Each branch maintains its own representation pathway and independently estimates relevance scores over the shared label space. DualMLC combines the two score vectors through late logit fusion, allowing shared evidence to reinforce relevant labels and branch-specific evidence to compensate for limitations in the other branch's representation. DualMLC achieves state-of-the-art results on three widely used large-scale multi-label text classification benchmarks. Ablation results further confirm that integrating the heterogeneous predictors produces stronger rankings than either branch alone. The source code is publicly available at https://github.com/huiyegit/DualMLC.