TY - JOUR
T1 - Proximal Gradient Algorithms Under Local Lipschitz Gradient Continuity
T2 - A Convergence and Robustness Analysis of PANOC
AU - De Marchi, Alberto
AU - Themelis, Andreas
N1 - Funding Information:
Open Access funding enabled and organized by Projekt DEAL. A. Themelis acknowledges the support of the Japan Society for the Promotion of Science (JSPS) KAKENHI Grant JP21K17710.
Publisher Copyright:
© 2022, The Author(s).
PY - 2022/9
Y1 - 2022/9
N2 - Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local Lipschitz gradient continuity for the smooth part of the objective function. We investigate an adaptive scheme for PANOC-type methods (Stella et al. in Proceedings of the IEEE 56th CDC, 2017), namely accelerated linesearch algorithms requiring only the simple oracle of proximal gradient. While including the classical proximal gradient method, our theoretical results cover a broader class of algorithms and provide convergence guarantees for accelerated methods with possibly inexact computation of the proximal mapping. These findings have also significant practical impact, as they widen scope and performance of existing, and possibly future, general purpose optimization software that invoke PANOC as inner solver.
AB - Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local Lipschitz gradient continuity for the smooth part of the objective function. We investigate an adaptive scheme for PANOC-type methods (Stella et al. in Proceedings of the IEEE 56th CDC, 2017), namely accelerated linesearch algorithms requiring only the simple oracle of proximal gradient. While including the classical proximal gradient method, our theoretical results cover a broader class of algorithms and provide convergence guarantees for accelerated methods with possibly inexact computation of the proximal mapping. These findings have also significant practical impact, as they widen scope and performance of existing, and possibly future, general purpose optimization software that invoke PANOC as inner solver.
UR - http://www.scopus.com/inward/record.url?scp=85133605085&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85133605085&partnerID=8YFLogxK
U2 - 10.1007/s10957-022-02048-5
DO - 10.1007/s10957-022-02048-5
M3 - Article
AN - SCOPUS:85133605085
SN - 0022-3239
VL - 194
SP - 771
EP - 794
JO - Journal of Optimization Theory and Applications
JF - Journal of Optimization Theory and Applications
IS - 3
ER -