Title
Deep correlation mining for multi-task image clustering
Abstract
Multi-task clustering (MTC) aims to enhance the performance of each individual task by leveraging the correlation information among them. Existing MTC algorithms usually first extract the feature representations of each task and then learn the relationships among multiple tasks for clustering. However, the multi-task correlations are not embedded into the feature learning in existing MTC. In addition, many real applications, such as image clustering, always perform visual feature extraction and clustering assignment separately, which often results in local optimal clustering resolutions. In this study, an end-to-end MTC framework, named Deep correlation mining for Multi-Task image Clustering (DMTC), is proposed to explore multi-task correlations and conduct image clustering simultaneously. Specifically, DMTC consists of two sub-networks: a between-task network (B-net) and a within-task network (W-net), which learn the correlations among multiple tasks and the relationships in each individual task, respectively, based on a deep convolutional network. To optimize B-net, an optimization procedure is proposed as follows: (1) DMTC builds a pseudo-graph to discover similar samples among tasks and obtain the positive pairs of possible related tasks. (2) A discriminator is designed to calculate the mutual information between the deep and shallow representations of related tasks, which can estimate the relatedness between each pair of related tasks. After that, the trained parameters in B-net are transferred to the within-task networks (W-net) as their initialized parameters, in which the above optimization procedure is performed again to obtain the final cluster partition by end-to-end training. Experimental results on NUS-Wide, Caltech-256, Cifar-100 and Pascal VOC demonstrate that our proposed DMTC method(1)compares favorably to the state-of-the-art methods.
Year
DOI
Venue
2022
10.1016/j.eswa.2021.115973
EXPERT SYSTEMS WITH APPLICATIONS
Keywords
DocType
Volume
Multi-task clustering, Deep clustering, Correlation mining, Image clustering
Journal
187
ISSN
Citations 
PageRank 
0957-4174
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Xiaoqiang Yan1205.35
Kaiyuan Shi200.34
Yangdong Ye311829.64
Hui Yu412821.50