Title
Characterizing Matrices That Are Consistent with Given Solutions
Abstract
For given vectors $b\in\mathbb{C}^m$ and $y\in\mathbb{C}^n$ we describe a unitary transformation approach to deriving the set $\mathcal{F}$ of all matrices $F\in\mathbb{C}^{m\times n}$ such that $y$ is an exact solution to the compatible system $Fy=b$. This is used for deriving minimal backward errors $E$ and $f$ such that $(A+E)y=b+f$ when possibly noisy data $A\in\mathbb{C}^{m\times n}$ and $b\in\mathbb{C}^m$ are given, and the aim is to decide if $y$ is a satisfactory approximate solution to $Ax=b$. The approach might be different, but the above results are not new. However, we also prove the apparently new result that two well-known approaches to making this decision are theoretically equivalent and discuss how such knowledge can be used in designing effective stopping criteria for iterative solution techniques. All these ideas generalize to the following formulations. We extend our constructive approach to derive a superset $\mathcal{F}_{STLS+}$ of the set $\mathcal{F}_{STLS}$ of all matrices $F\in\mathbb{C}^{m\times n}$ such that $y$ is a scaled total least squares solution to $Fy\approx b$. This is a new general result that specializes in two important ways. The ordinary least squares problem is an extreme case of the scaled total least squares problem, and we use our result to obtain the set $\mathcal{F}_{LS}$ of all matrices $F\in\mathbb{C}^{m\times n}$ such that $y$ is an exact least squares solution to $Fy\approx b$. This complements the original less-constructive derivation of Waldén, Karlson, and Sun [Numer. Linear Algebra Appl., 2 (1995), pp. 271-286]. We do the equivalent for the data least squares problem—the other extreme case of the scaled total least squares problem. Not only can the results be used as indicated above for the compatible case, but the constructive technique we use could also be applicable to other backward problems—such as those for underdetermined systems, the singular value decomposition, and the eigenproblem.
Year
DOI
Venue
2008
10.1137/060675691
SIAM J. Matrix Analysis Applications
Keywords
Field
DocType
constructive approach,exact solution,times n,characterizing matrices,iterative solution technique,extreme case,squares solution,squares problem,compatible case,new general result,satisfactory approximate solution,linear algebra,iterative methods,iteration method,total least squares,numerical linear algebra,singular value decomposition,least squares
Exact solutions in general relativity,Least squares,Singular value decomposition,Linear equation,Linear algebra,Combinatorics,Mathematical optimization,Matrix (mathematics),Unitary transformation,Total least squares,Mathematics
Journal
Volume
Issue
ISSN
30
4
0895-4798
Citations 
PageRank 
References 
3
0.57
9
Authors
3
Name
Order
Citations
PageRank
X.-W. Chang150.96
C. C. Paige2469.00
D. Titley-Peloquin3172.48