Title
Damped Techniques for the Limited Memory BFGS Method for Large-Scale Optimization
Abstract
This paper is aimed to extend a certain damped technique, suitable for the Broyden---Fletcher---Goldfarb---Shanno (BFGS) method, to the limited memory BFGS method in the case of the large-scale unconstrained optimization. It is shown that the proposed technique maintains the global convergence property on uniformly convex functions for the limited memory BFGS method. Some numerical results are described to illustrate the important role of the damped technique. Since this technique enforces safely the positive definiteness property of the BFGS update for any value of the steplength, we also consider only the first Wolfe---Powell condition on the steplength. Then, as for the backtracking framework, only one gradient evaluation is performed on each iteration. It is reported that the proposed damped methods work much better than the limited memory BFGS method in several cases.
Year
DOI
Venue
2014
10.1007/s10957-013-0448-8
J. Optimization Theory and Applications
Keywords
DocType
Volume
powell condition,positive definiteness property,gradient evaluation,convex function,limited memory,bfgs method,large-scale optimization,damped techniques,limited memory bfgs method,global convergence property,important role,proposed technique,bfgs update,backtracking framework
Journal
161
Issue
ISSN
Citations 
2
1573-2878
3
PageRank 
References 
Authors
0.39
6
3
Name
Order
Citations
PageRank
Mehiddin Al-Baali1233.45
Lucio Grandinetti27616.29
Ornella Pisacane311610.20