Title
Underestimate Sequences via Quadratic Averaging.
Abstract
In this work we introduce the concept of an Underestimate Sequence (UES), which is a natural extension of Nesterovu0027s estimate sequence. Our definition of a UES utilizes three sequences, one of which is a lower bound (or under-estimator) of the objective function. The question of how to construct an appropriate sequence of lower bounds is also addressed, and we present lower bounds for strongly convex smooth functions and for strongly convex composite functions, which adhere to the UES framework. Further, we propose several first order methods for minimizing strongly convex functions in both the smooth and composite cases. The algorithms, based on efficiently updating lower bounds on the objective functions, have natural stopping conditions, which provides the user with a certificate of optimality. Convergence of all algorithms is guaranteed through the UES framework, and we show that all presented algorithms converge linearly, with the accelerated variants enjoying the optimal linear rate of convergence.
Year
Venue
Field
2017
arXiv: Optimization and Control
Convergence (routing),Mathematical optimization,Upper and lower bounds,First order,Quadratic equation,Convex function,Rate of convergence,Mathematics,Certificate
DocType
Volume
Citations 
Journal
abs/1710.03695
0
PageRank 
References 
Authors
0.34
1
5
Name
Order
Citations
PageRank
Chenxin Ma1735.25
Naga Venkata C. Gudapati200.34
Majid Jahani301.01
Rachel Tappenden4685.56
Martin Takác575249.49