论文

用模拟器反事实数据解决新策略冷启动预测问题

Forecasting from Counterfactual Simulator Rollouts: A Sim2Real Evaluation

精选理由

亚马逊这类库存场景的实操研究:新策略一上线预测模型就没数据,用模拟器 rollout 造数据训练,MAPE 最多降 18.7 个点,落地细节都在

arXiv 论文提出用模拟器对目标策略做反事实 rollout,生成轨迹训练预测模型,解决新决策策略上线时缺少真实观测的冷启动难题。在两个真实库存控制部署上评估,模拟器训练的预测器比同一架构用历史真实数据训练的 MAPE 低 1.2-3.1 个百分点(Study 1)和 12.5-18.7 个百分点(Study 2)。部署后用早期真实观测做轻量校准,可再降最多 2.5 个百分点误差。论文从模拟器保真度、零样本迁移和随真实数据累积的自适应三个角度验证了 Sim2Real 转移效果。

原文 · arXiv cs.LG

Forecasting from Counterfactual Simulator Rollouts: A Sim2Real Evaluation

Deploying a new decision policy creates a cold-start problem for prediction models whose targets depend on the policy's actions: historical observations reflect earlier policies, while real observations under the new policy are not yet available. Simulation offers a way to address this gap by rolling out the target policy across counterfactual scenarios and using the resulting trajectories to learn how the system responds to those controls. The simulation-to-reality (Sim2Real) transfer of this simulator-trained model can then be backtested by evaluating it against real observations from past deployments. Using two real-world inventory-control deployments, we evaluate this process from three angles: simulator fidelity, zero-shot transfer to real behavior, and adaptation as real target-policy observations accumulate. The simulator-trained forecaster achieves lower point-estimate mean absolute percentage error (MAPE) than the same architecture trained on historical real data, reducing MAPE by 1.2-3.1 percentage points in Study 1 and 12.5-18.7 points in Study 2. After deployment, lightweight calibration using early real observations further reduces error by up to 2.5 percentage points. These results provide empirical evidence that simulator-generated counterfactual data can support cold-start forecasting under a new policy, and the resulting model can be further refined as real deployment data become available.