Title
Stabilized SQP revisited
Abstract
The stabilized version of the sequential quadratic programming algorithm (sSQP) had been developed in order to achieve superlinear convergence in situations when the Lagrange multipliers associated to a solution are not unique. Within the framework of Fischer (Math Program 94:91–124, 2002), the key to local superlinear convergence of sSQP are the following two properties: upper Lipschitzian behavior of solutions of the Karush-Kuhn-Tucker (KKT) system under canonical perturbations and local solvability of sSQP subproblems with the associated primal-dual step being of the order of the distance from the current iterate to the solution set of the unperturbed KKT system. According to Fernández and Solodov (Math Program 125:47–73, 2010), both of these properties are ensured by the second-order sufficient optimality condition (SOSC) without any constraint qualification assumptions. In this paper, we state precise relationships between the upper Lipschitzian property of solutions of KKT systems, error bounds for KKT systems, the notion of critical Lagrange multipliers (a subclass of multipliers that violate SOSC in a very special way), the second-order necessary condition for optimality, and solvability of sSQP subproblems. Moreover, for the problem with equality constraints only, we prove superlinear convergence of sSQP under the assumption that the dual starting point is close to a noncritical multiplier. Since noncritical multipliers include all those satisfying SOSC but are not limited to them, we believe this gives the first superlinear convergence result for any Newtonian method for constrained optimization under assumptions that do not include any constraint qualifications and are weaker than SOSC. In the general case when inequality constraints are present, we show that such a relaxation of assumptions is not possible. We also consider applying sSQP to the problem where inequality constraints are reformulated into equalities using slack variables, and discuss the assumptions needed for convergence in this approach. We conclude with consequences for local regularization methods proposed in (Izmailov and Solodov SIAM J Optim 16:210–228, 2004; Wright SIAM J. Optim. 15:673–676, 2005). In particular, we show that these methods are still locally superlinearly convergent under the noncritical multiplier assumption, weaker than SOSC employed originally.
Year
DOI
Venue
2012
10.1007/s10107-010-0413-3
Math. Program.
Keywords
Field
DocType
inequality constraint,math program,kkt system,satisfying sosc,local superlinear convergence,superlinear convergence,noncritical multiplier,ssqp subproblems,unperturbed kkt system,stabilized sqp revisited,superlinear convergence result
Convergence (routing),Mathematical optimization,Slack variable,Lagrange multiplier,Multiplier (economics),Solution set,Sequential quadratic programming,Karush–Kuhn–Tucker conditions,Mathematics,Constrained optimization
Journal
Volume
Issue
ISSN
133
1-2
1436-4646
Citations 
PageRank 
References 
23
0.93
15
Authors
2
Name
Order
Citations
PageRank
A. F. Izmailov123821.76
M. V. Solodov260072.47