Paper Info
Title
Analysis of a Classical Matrix Preconditioning Algorithm.
Abstract
We study a classical iterative algorithm for balancing matrices in the L∞ norm via a scaling transformation. This algorithm, which goes back to Osborne and Parlett 8 Reinsch in the 1960s, is implemented as a standard preconditioner in many numerical linear algebra packages. Surprisingly, despite its widespread use over several decades, no bounds were known on its rate of convergence. In this article, we prove that, for any irreducible n × n (real or complex) input matrix A, a natural variant of the algorithm converges in O(n3log (nρ/ϵ)) elementary balancing operations, where ρ measures the initial imbalance of A and ϵ is the target imbalance of the output matrix. (The imbalance of A is |log(aiout/aiin)|, where aiout, aiin are the maximum entries in magnitude in the ith row and column, respectively.) This bound is tight up to the log n factor. A balancing operation scales the ith row and column so that their maximum entries are equal, and requires O(m/n) arithmetic operations on average, where m is the number of nonzero elements in A. Thus, the running time of the iterative algorithm is Õ(n2m). This is the first time bound of any kind on any variant of the Osborne-Parlett-Reinsch algorithm. We also prove a conjecture of Chen that characterizes those matrices for which the limit of the balancing process is independent of the order in which balancing operations are performed.
Year
DOI
Venue
2015
10.1145/2988227
J. ACM
Keywords
Field
DocType
Numerical linear algebra,preconditioning matrices,matrix balancing,matrix scaling
Discrete mathematics,Binary logarithm,Combinatorics,Preconditioner,Matrix (mathematics),Iterative method,Algorithm,Rate of convergence,Iterative proportional fitting,Scaling,Mathematics,Numerical linear algebra
Journal
Volume
Issue
ISSN
64
2
0004-5411
Citations 
PageRank 
References 
3
0.56
8
Authors
2
Name
Order
Citations
PageRank
Leonard J. Schulman11328136.88
Alistair Sinclair230.90