Title
Row-Wise Backward Stable Elimination Methods for the Equality Constrained Least Squares Problem
Abstract
It is well known that the solution of the equality constrained least squares (LSE) problem minBx=d||b-Ax||2 is the limit of the solution of the unconstrained weighted least squares problem $$ \min_x\left\| \bmatrix{ \mu d \cr b } - \bmatrix{\mu B \cr A } x \right\|_2 $$ as the weight $\mu$ tends to infinity, assuming that $\bmatrix{B^T & A^T \cr}^T$ has full rank. We derive a method for the LSE problem by applying Householder QR factorization with column pivoting to this weighted problem and taking the limit analytically, with an appropriate rescaling of rows. The method obtained is a type of direct elimination method. We adapt existing error analysis for the unconstrained problem to obtain a row-wise backward error bound for the method. The bound shows that, provided row pivoting or row sorting is used, the method is well-suited to problems in which the rows of A and B vary widely in norm. As a by-product of our analysis, we derive a row-wise backward error bound of precisely the same form for the standard elimination method for solving the LSE problem. We illustrate our results with numerical tests.
Year
DOI
Venue
1999
10.1137/S0895479898335957
SIAM Journal on Matrix Analysis and Applications
Keywords
Field
DocType
constrained least squares problem,weighted least squares problem,Householder QR factorization,Gaussian elimination,elimination method,rounding error analysis,backward stability,row pivoting,row sorting,column pivoting
Rank (linear algebra),Least squares,Row,Discrete mathematics,Mathematical optimization,Combinatorics,Matrix (mathematics),Infinity,Sorting,Gaussian elimination,Mathematics,QR decomposition
Journal
Volume
Issue
ISSN
21
1
0895-4798
Citations 
PageRank 
References 
2
0.44
3
Authors
2
Name
Order
Citations
PageRank
Anthony J Cox119813.63
Nicholas J. Higham21576246.67