论文

KL 散度球结合学习密度模型,改进分布鲁棒优化的场景生成

Adaptive Scenario Generation for KL-DRO Around a Learned Density Model

精选理由

一篇优化方向的方法论文,把 DRO 的模糊球从经验分布换成学习到的密度模型,还配了自适应采样算法,做运筹和随机优化的人可以看看。

这篇论文提出将 KL 散度球围绕拟合数据得到的学习密度模型构建,而非传统 DRO 中的经验分布或 Wasserstein 输运球。对手可以按模型赋予的概率对昂贵且未被观测到的实现进行加权。作者设计了自适应场景生成算法,在求解有限问题和从学习分布抽取新实现之间交替,并用重要性权重修正采样偏差。在多商品报童问题和基于真实电网数据的容量扩张问题上,当数据稀缺且模型类能外推时,该方法的分布偏移下成本更低,同分布成本相当;当数据量增大或偏移偏离模型结构时优势消失。

原文 · arXiv cs.LG

Adaptive Scenario Generation for KL-DRO Around a Learned Density Model

Distributionally robust optimization (DRO) hedges data-driven two-stage stochastic programs against error in the distribution estimated from a finite record, and standard ambiguity sets differ in how they treat realizations absent from that record. A divergence ball around the empirical distribution contains only reweightings of the record, whereas a transport ball also contains distributions supported off the record, including on realizations the data-generating process cannot produce, against which the decision is then hedged as well. We instead propose a Kullback-Leibler (KL) ball centered at a density model fitted to the record, the learned nominal, which lets the adversary up-weight costly unobserved realizations in proportion to the probability the model assigns them. Solving the resulting problem poses a second difficulty, because it can accommodate only a few scenarios, and an independent sample of that size is likely to omit the rare realizations on which the worst case concentrates. We therefore build the scenario set adaptively, alternating between solving the finite problem and drawing new realizations from the learned nominal, steered toward the worst case at the current decision, with importance weights that correct the draws back to the model. On a multi-item newsvendor problem and a capacity expansion problem on realistic grid data, centering the ball at the learned nominal rather than at the record lowers cost under distribution shift, at comparable in-distribution cost, when the record is scarce and the model class captures structure that lets it extrapolate beyond the record. The advantage fades as the record grows or as the shift departs from the structure the model has learned.