Title
Self-Supervised Symmetric Nonnegative Matrix Factorization
Abstract
Symmetric nonnegative matrix factorization (SNMF) has demonstrated to be a powerful method for data clustering. However, SNMF is mathematically formulated as a non-convex optimization problem, making it sensitive to the initialization of variables. Inspired by ensemble clustering that aims to seek a better clustering result from a set of clustering results, we propose self-supervised SNMF (S <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> NMF), which is capable of boosting clustering performance progressively by taking advantage of the sensitivity to initialization characteristic of SNMF, without relying on any additional information. Specifically, we first perform SNMF repeatedly with a random positive matrix for initialization each time, leading to multiple decomposed matrices. Then, we rank the quality of the resulting matrices with adaptively learned weights, from which a new similarity matrix that is expected to be more discriminative is reconstructed for SNMF again. These two steps are iterated until the stopping criterion/maximum number of iterations is achieved. We mathematically formulate S <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> NMF as a constrained optimization problem, and provide an alternative optimization algorithm to solve it with the theoretical convergence guaranteed. Extensive experimental results on 10 commonly used benchmark datasets demonstrate the significant advantage of our S <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> NMF over 14 state-of-the-art methods in terms of 5 quantitative metrics. The source code is publicly available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/jyh-learning/SSSNMF</uri> .
Year
DOI
Venue
2022
10.1109/TCSVT.2021.3129365
IEEE Transactions on Circuits and Systems for Video Technology
Keywords
DocType
Volume
Symmetric nonnegative matrix factorization,dimensionality reduction,clustering
Journal
32
Issue
ISSN
Citations 
7
1051-8215
0
PageRank 
References 
Authors
0.34
31
5
Name
Order
Citations
PageRank
Yuheng Jia19313.13
Hui Liu292.80
Junhui Hou339549.84
Sam Kwong44590315.78
Qingfu Zhang500.34