论文精选73°

蒸馏全局知识,适应本地需求:可扩展升级推荐框架

Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation

精选理由

这个框架让LLM推理能力提升5000倍速度、降低10000倍成本,专为大规模产品升级推荐设计。

研究人员提出两级框架,将大语言模型推理能力蒸馏为高效非生成式学生模型。第一级使用检索增强少样本LLM教师生成结构化关系标签和自然语言理由,监督紧凑的嵌入对分类器。在8,352对人工标注基准上,1550万参数的推理蒸馏学生模型达到0.924的AUC值。第二级产品类型测试时训练使用少样本演示优化轻量级特定类别适配器,将AUC提升至0.941。

原文 · arXiv cs.LG

Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation

Trade-up recommendation identifies higher-quality alternatives that preserve a customer's purchase intent while offering upgraded benefits. Large language models (LLMs) can reason about such distinctions, but applying them directly to hundreds of millions of product pairs is operationally impractical. We introduce a two-level framework that distills LLM reasoning into an efficient non-generative student and adapts its decision boundary to product-type-specific trade-up criteria. At Level 1, a retrieval-augmented few-shot LLM teacher generates structured relation labels and natural-language rationales. These rationales supervise a compact embedding-pair classifier through alignment and contrastive objectives; at inference, the student uses only two precomputed 768-dimensional product embeddings, with no LLM calls or text generation. On a fixed human-annotated benchmark of 8,352 pairs, a 15.5M-parameter four-class reasoning-distilled student achieves AUC 0.924 (95% CI [0.918, 0.929]), compared with 0.912 for the four-class label-only student. At Level 2, product-type test-time training (PT-TTT) uses few-shot demonstrations to optimize lightweight category-specific adapters over the frozen student. PT-TTT improves AUC from 0.924 to 0.941 and average precision from 0.920 to 0.940. On a 100K-pair proxy catalog, the distilled student on a single eight-GPU machine is approximately 5,000x faster and 10,000x lower in estimated cost than direct LLM inference.