Title
Fixed point and Bregman iterative methods for matrix rank minimization
Abstract
The linearly constrained matrix rank minimization problem is widely applicable in many fields such as control, signal processing and system identification. The tightest convex relaxation of this problem is the linearly constrained nuclear norm minimization. Although the latter can be cast as a semidefinite programming problem, such an approach is computationally expensive to solve when the matrices are large. In this paper, we propose fixed point and Bregman iterative algorithms for solving the nuclear norm minimization problem and prove convergence of the first of these algorithms. By using a homotopy approach together with an approximate singular value decomposition procedure, we get a very fast, robust and powerful algorithm, which we call FPCA (Fixed Point Continuation with Approximate SVD), that can solve very large matrix rank minimization problems (the code can be downloaded from http://www.columbia.edu/~sm2756/FPCA.htmfor non-commercial use). Our numerical results on randomly generated and real matrix completion problems demonstrate that this algorithm is much faster and provides much better recoverability than semidefinite programming solvers such as SDPT3. For example, our algorithm can recover 1000 × 1000 matrices of rank 50 with a relative error of 10−5 in about 3 min by sampling only 20% of the elements. We know of no other method that achieves as good recoverability. Numerical experiments on online recommendation, DNA microarray data set and image inpainting problems demonstrate the effectiveness of our algorithms.
Year
DOI
Venue
2009
10.1007/s10107-009-0306-5
Mathematical Programming: Series A and B
Keywords
DocType
Volume
large matrix rank minimization,good recoverability,real matrix completion problem,nuclear norm minimization,nuclear norm minimization problem,better recoverability,fixed point,semidefinite programming problem,minimization problem,powerful algorithm,bregman iterative algorithm,matrix rank minimizationmatrix completion problemnuclear norm minimizationfixed point iterative methodbregman distancessingular value decomposition,bregman iterative method,iterative algorithm,singular value decomposition,iteration method,relative error,signal processing,system identification
Journal
128
Issue
ISSN
Citations 
1-2
1436-4646
384
PageRank 
References 
Authors
21.36
33
3
Search Limit
100384
Name
Order
Citations
PageRank
Shiqian Ma1106863.48
Donald Goldfarb250030.02
Lifeng Chen338421.36