论文精选

一种用于校准测试时提示调优的温标缩放方法

Bridging the Confidence Gap: Temperature Scaling for Calibrating Test-Time Prompt Tuning

精选理由

这个方法很实用,能解决测试时提示调优中常见的校准问题,而且实验数据很扎实,效果提升明显。

这篇论文提出了一种名为CoTS的方法,通过温标缩放来最小化自适应预测和零样本预测之间的置信度差距,从而在保持准确率的同时改善校准性能。

正文

该方法在ImageNet变体数据集上,将TPT的期望校准误差从11.90%降低到5.

38%,同时将准确率从60.74%提升到62.

95%。

原文 · arXiv cs.LG

Bridging the Confidence Gap: Temperature Scaling for Calibrating Test-Time Prompt Tuning

Test-time prompt tuning (TPT) enables adaptation on a single test instance, achieving improved accuracy but often sacrificing calibration performance. Most existing calibration methods introduce additional regularization terms to promote dispersion across text embeddings and reduce calibration error, yet these methods often suffer from a drop in accuracy. Motivated by the well-calibrated nature of zero-shot predictions, we propose CoTS, a simple yet effective post-hoc calibration method that preserves accuracy. Specifically, CoTS applies temperature scaling to minimize the confidence gap between adapted and zero-shot predictions. To fully exploit the potential of multiple augmentations during adaptation, we introduce a weak-strong ensemble strategy that further boosts accuracy. We then apply CoTS to this ensemble, termed E-CoTS, to maintain its well-calibrated property. Extensive experiments on diverse datasets and backbones show that our approaches effectively mitigate miscalibration without compromising primary accuracy. For instance, E-CoTS reduces the average expected calibration error of TPT from 11.90% to 5.38% on ImageNet variants, while even increasing accuracy from 60.74% to 62.95%. Moreover, when integrated with existing calibration methods, E-CoTS usually enhances both accuracy and calibration simultaneously.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Calibrating Test-Time Prompt Tuning、提示词工程、校准,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.LG」(@Yuwei Liang, Jian Liang, Dapeng Hu, Yinuo Xu, Ran He),经 AITOP 多维评分管线结构化提炼。