Title
Damped techniques for enforcing convergence of quasi-Newton methods
Abstract
This paper extends the technique used in the damped BFGS method of Powell [Algorithms for nonlinear constraints that use Lagrange functions, Math. Program. 14 (1978), 224-248] to the Broyden family of quasi-Newton methods with applications to unconstrained optimization problems. Appropriate conditions on the damped technique are proposed to enforce safely the positive definiteness property for all Broyden's updates. It is shown that this technique maintains the q-superlinear convergence property of the restricted Broyden family of methods for uniformly convex functions. It also extends the global convergence property to all members of the family. Preliminary numerical results are described which show that appropriate ways for employing the proposed technique improve the performance of all members of the Broyden family of methods substantially and significantly in certain cases. They also enforce convergence of divergent quasi-Newton methods.
Year
DOI
Venue
2014
10.1080/10556788.2014.891030
Optimization Methods & Software
Keywords
Field
DocType
damped techniques,line search framework,quasi-newton methods,unconstrained optimization
Convergence (routing),Mathematical optimization,Nonlinear system,Convex function,Positive definiteness,Broyden–Fletcher–Goldfarb–Shanno algorithm,Optimization problem,Mathematics,Broyden's method
Journal
Volume
Issue
ISSN
29
5
1055-6788
Citations 
PageRank 
References 
1
0.36
7
Authors
1
Name
Order
Citations
PageRank
Mehiddin Al-Baali1233.45