Title
Solving Karush--Kuhn--Tucker Systems via the Trust Region and the Conjugate Gradient Methods
Abstract
A popular approach to solving the Karush--Kuhn--Tucker (KKT) system, mainly arising from the variational inequality problem, is to reformulate it as a constrained minimization problem with simple bounds. In this paper, we propose a trust region method for solving the reformulation problem with the trust region subproblems being solved by the truncated conjugate gradient (CG) method, which is cost effective. Other advantages of the proposed method over existing ones include the fact that a good approximated solution to the trust region subproblem can be found by the truncated CG method and is judged in a simple way; also, the working matrix in each iteration is H, instead of the condensed HTH, where H is a matrix element of the generalized Jacobian of the function used in the reformulation. As a matter of fact, the matrix used is of reduced dimension. We pay extra attention to ensure the success of the truncated CG method as well as the feasibility of the iterates with respect to the simple constraints. Another feature of the proposed method is that we allow the merit function value to be increased at some iterations to speed up the convergence. Global and superlinear/quadratic convergence is shown under standard assumptions. Numerical results are reported on a subset of problems from the MCPLIB collection [S. P. Dirkse and M. C. Ferris, Optim. Methods Softw., 5 (1995), pp. 319--345].
Year
DOI
Venue
2003
10.1137/S105262340038256X
SIAM Journal on Optimization
Keywords
Field
DocType
simple bound,truncated conjugate gradient,tucker systems,simple constraint,trust region,reformulation problem,conjugate gradient methods,minimization problem,trust region method,matrix element,truncated cg method,conjugate gradient method,constrained optimization,karush kuhn tucker
Conjugate gradient method,Trust region,Mathematical optimization,Rate of convergence,Nonlinear conjugate gradient method,Karush–Kuhn–Tucker conditions,Mathematics,Constrained optimization,Variational inequality,Conjugate residual method
Journal
Volume
Issue
ISSN
14
2
1052-6234
Citations 
PageRank 
References 
10
0.58
14
Authors
3
Name
Order
Citations
PageRank
Houduo Qi143732.91
Liqun Qi23155284.52
Defeng Sun3147591.95