Paper Info
Title
Consistency regularization for deep semi-supervised clustering with pairwise constraints
Abstract
Due to its powerful learning capabilities for high-dimensional and complex data, deep semi-supervised clustering algorithms often outperform traditional semi-supervised clustering methods. However, most deep semi-supervised clustering methods cannot fully utilize prior knowledge and unlabeled data. Deep semi-supervised classification algorithms have recently made significant progress in using unlabeled data during training by combining a consistency regularization method. Consistency training encourages network predictions to remain consistent when the input is perturbed. Motivated by the success of consistency regularization methods, we proposed a new semi-supervised clustering framework based on Siamese networks. To leverage the additional structure of unlabeled data and to uncover more information hidden by pairwise constraints, we add a consistency regularization loss, calculated on unlabeled data and pairwise constraints, to our objective function. After consistency training, the connected data can be closer in the learned feature space, while the disconnected data can be far away. To verify the effectiveness of the proposed method, we conducted extensive experiments on several real-world data sets. Experimental results show that the proposed method is more effective than other state-of-the-art methods in clustering performance.
Year
DOI
Venue
2022
10.1007/s13042-022-01599-3
International Journal of Machine Learning and Cybernetics
Keywords
DocType
Volume
Semi-supervised clustering, Deep learning, Pairwise constraints, Consistency regularization, Siamese network, Pseudo-Siamese network
Journal
13
Issue
ISSN
Citations 
11
1868-8071
0
PageRank 
References 
Authors
0.34
16
5
Name
Order
Citations
PageRank
Huang Dan100.34
Jie Hu293.89
Tianrui Li33176191.76
Du Shengdong400.34
Hongmei Chen573825.19