Title
Analysis of a Symmetric Rank-One Trust Region Method
Abstract
Several recent computational studies have shown that the symmetric rank-one (SR1) update is a very competitive quasi-Newton update in optimization algorithms. This paper gives a new analysis of a trust region SR1 method for unconstrained optimization and shows that the method has an $n+1$ step $q$-superlinear rate of convergence. The analysis makes neither of the assumptions of uniform linear independence of the iterates nor positive definiteness of the Hessian approximations that have been made in other recent analyses of SR1 methods. The trust region method that is analyzed is fairly standard, except that it includes the feature that the Hessian approximation is updated after all steps, including rejected steps. We also present computational results that show that this feature, safeguarded in a way that is consistent with the convergence analysis, does not harm the efficiency of the SR1 trust region method.
Year
DOI
Venue
1996
10.1137/S1052623493252985
SIAM Journal on Optimization
Keywords
Field
DocType
quasi-Newton method,symmetric rank-one update,superlinear convergence
Convergence (routing),Trust region,Quasi-Newton method,Mathematical optimization,Linear independence,Hessian matrix,Symmetric rank-one,Rate of convergence,Positive definiteness,Mathematics
Journal
Volume
Issue
ISSN
6
4
1052-6234
Citations 
PageRank 
References 
16
1.27
0
Authors
3
Name
Order
Citations
PageRank
Richard H. Byrd12234227.38
Humaid Khalfan2161.27
Robert B. Schnabel3565143.88