Title
Worst-case evaluation complexity of regularization methods for smooth unconstrained optimization using Hölder continuous gradients
Abstract
AbstractThe worst-case behaviour of a general class of regularization algorithms is considered in the case where only objective function values and associated gradient vectors are evaluated. Upper bounds are derived on the number of such evaluations that are needed for the algorithm to produce an approximate first-order critical point whose accuracy is within a user-defined threshold. The analysis covers the entire range of meaningful powers in the regularization term as well as in the Hölder exponent for the gradient. The resulting complexity bounds vary according to the regularization power and the assumed Hölder exponent, recovering known results when available.
Year
DOI
Venue
2017
10.1080/10556788.2016.1268136
Periodicals
Keywords
Field
DocType
nonlinear optimisation,regularization methods,complexity analysis
Mathematical optimization,Nonlinear programming,Backus–Gilbert method,Critical point (thermodynamics),Regularization (mathematics),Hölder condition,Proximal gradient methods for learning,Numerical analysis,Mathematics,Regularization perspectives on support vector machines
Journal
Volume
Issue
ISSN
32
6
1055-6788
Citations 
PageRank 
References 
0
0.34
7
Authors
3
Name
Order
Citations
PageRank
Coralia Cartis145128.74
Nicholas I. M. Gould21445123.86
Ph. L. Toint3927197.61