Title
Off-Diagonal Symmetric Nonnegative Matrix Factorization
Abstract
Symmetric nonnegative matrix factorization (symNMF) is a variant of nonnegative matrix factorization (NMF) that allows handling symmetric input matrices and has been shown to be particularly well suited for clustering tasks. In this paper, we present a new model, dubbed off-diagonal symNMF (ODsymNMF), that does not take into account the diagonal entries of the input matrix in the objective function. ODsymNMF has three key advantages compared to symNMF. First, ODsymNMF is theoretically much more sound as there always exists an exact factorization of size at most n(n - 1)/2 where n is the dimension of the input matrix. Second, it makes more sense in practice as diagonal entries of the input matrix typically correspond to the similarity between an item and itself, not bringing much information. Third, it makes the optimization problem much easier to solve. In particular, it will allow us to design an algorithm based on coordinate descent that minimizes the component-wise l(1) norm between the input matrix and its approximation. We prove that this norm is much better suited for binary input matrices often encountered in practice. We also derive a coordinate descent method for the component-wise l(2) norm, and compare the two approaches with symNMF on synthetic and document datasets.
Year
DOI
Venue
2021
10.1007/s11075-020-01063-9
NUMERICAL ALGORITHMS
Keywords
DocType
Volume
Nonnegative matrix factorization, Clustering, &#8467, (1) norm, Coordinate descent
Journal
88
Issue
ISSN
Citations 
2
1017-1398
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Moutier François100.34
A. Vandaele2203.89
Nicolas Gillis350339.77