An Adaptive Linesearch-free Method for Monotone Variational Inequalities under Local Lipschitz Continuity
arXiv.org
An Adaptive Linesearch-free Method for Monotone Variational Inequalities under Local Lipschitz Continuity
The forward-reflected-backward (FRB) splitting solves inclusion problems involving the sum of a maximally monotone operator and a monotone Lipschitz continuous operator. Each iteration performs one resolvent step and one evaluation of the Lipschitz operator, plus a reflection term with coefficient one that reuses the previous operator value. We consider the setting where the maximally monotone operator is the subdifferential of a proper, lower semicontinuous, convex function. We identify the tight admissible range of constant reflection coefficients, namely all values larger than one half for a sufficiently small stepsize. We then propose a linesearch-free adaptive variant of FRB for locally Lipschitz continuous operators, in which both the stepsize and the reflection coefficient change across iterations. The stepsize is computed in closed form from a simple local Lipschitz estimate, without requiring the existence or knowledge of a global Lipschitz constant, while maintaining the iteration cost of FRB. The analysis of both methods relies on a new Lyapunov function that combines the distance to a solution, successive differences of iterates, and a gap-type term. The individual terms need not decrease along the iterates, but the stepsize conditions ensure that their weighted combination does. Moreover, alongside nonasymptotic rates, we derive explicit lower bounds on the generated stepsizes, and showcase the effectiveness of the adaptive method through numerical experiments on minimax problems, equilibrium models, and regularized regression.
0 comments
No comments yet.