Title
A NONMONOTONE ALTERNATING UPDATING METHOD FOR A CLASS OF MATRIX FACTORIZATION PROBLEMS
Abstract
In this paper we consider a general matrix factorization model which covers a large class of existing models with many applications in areas such as machine learning and imaging sciences. To solve this possibly nonconvex, nonsmooth, and non-Lipschitz problem, we develop a nonmonotone alternating updating method based on a potential function. Our method essentially updates two blocks of variables in turn by inexactly minimizing this potential function, and updates another auxiliary block of variables using an explicit formula. The special structure of our potential function allows us to take advantage of efficient computational strategies for nonnegative matrix factorization to perform the alternating minimization over the two blocks of variables. A suitable line search criterion is also incorporated to improve the numerical performance. Under some mild conditions, we show that the line search criterion is well defined, and establish that the sequence generated is bounded and any cluster point of the sequence is a stationary point. Finally, we conduct some numerical experiments using real datasets to compare our method with some existing efficient methods for nonnegative matrix factorization and matrix completion. The numerical results show that our method can outperform these methods for these specific applications.
Year
DOI
Venue
2018
10.1137/17M1130113
SIAM JOURNAL ON OPTIMIZATION
Keywords
DocType
Volume
matrix factorization,nonmonotone line search,stationary point,alternating updating
Journal
28
Issue
ISSN
Citations 
4
1052-6234
0
PageRank 
References 
Authors
0.34
21
3
Name
Order
Citations
PageRank
Lei Yang1433.05
Ting Kei Pong242723.18
Xiaojun Chen31298107.51