论文精选

提出一种单循环外梯度方法解决强凸-强凹极小极大优化问题

Near-Optimal Pure Single-Loop Extragradient Method for Strongly Convex--Strongly Concave Minimax Optimization

精选理由

学术研究者可以看看这篇论文,提出了一种新的优化方法,理论证明很扎实,数值实验也验证了效果。

研究了一类强凸-强凹极小极大优化问题,提出了一种固定参数的单循环阻尼外梯度方法,每迭代两次全梯度计算后仅需一次初始化查询。该方法使用辅助反馈递归,无需内求解、精度调度或阶段重启。理论证明其最后一迭代点线性收敛,将鞍点距离缩小到初始值的ε倍需要O(√(κ_xκ_y)log(2κ_xκ_y/ε))次全梯度查询,其中κ_x=L/μ_x和κ_y=L/μ_y,该界达到了最优条件数阶次(除对数因子外)。

原文 · arXiv cs.LG

Near-Optimal Pure Single-Loop Extragradient Method for Strongly Convex--Strongly Concave Minimax Optimization

We study smooth strongly convex--strongly concave minimax optimization with general nonlinear coupling in the deterministic unconstrained setting. We propose a pure single-loop damped extragradient method with fixed parameters and two new full-gradient evaluations per iteration after one initialization query. The method uses an auxiliary feedback recursion and requires no inner solves, accuracy schedules, or staged restarts. We establish last-iterate linear convergence and show that reducing the squared Euclidean distance to the saddle point to an $\varepsilon$ fraction of its initial value requires $O(\sqrt{κ_xκ_y}\log(2κ_xκ_y/\varepsilon))$ full-gradient queries, where $κ_x=L/μ_x$ and $κ_y=L/μ_y$. This bound attains the optimal condition-number order up to logarithmic factors through fixed explicit updates. Numerical experiments demonstrate the effectiveness of the method.