Title
Distributed Semi-Supervised Metric Learning.
Abstract
Over the last decade, many pairwise-constraint-based metric learning algorithms have been developed to automatically learn application-specific metrics from data under similarity/dissimilarity data pair constraints (weak labels). Nevertheless, these existing methods are designed for the centralized learning case, in which all the data and constraints are supposed to be gathered together in one source, and the algorithms utilize the whole data and constraints information during the learning process. However, in many real applications, large amounts of data (constraints) are dispersedly generated/stored in geographically distributed nodes over networks. Thus, it might be impractical to centralize the whole data information to one fusion node. Besides, in such cases, it is often hard to have every data pair labeled due to the huge data pair amounts, resulting in numerous unlabeled data pairs. Given these situations, in this paper, we propose two types, namely, a diffusion type and an alternating-direction-method-of-multipliers type, of distributed semi-supervised metric learning frameworks, which make use of both labeled and unlabeled data pairs. The proposed frameworks can be easily used to extend centralized metric learning methods of different objective functions to distributed cases. In particular, we apply our frameworks on a well-behaved centralized semi-supervised metric learning method called SERAPH and yield two new distributed semi-supervised metric learning algorithms. Our simulation results show that the metrics learned by the proposed distributed algorithms are very close to that of the corresponding centralized method in most cases.
Year
DOI
Venue
2016
10.1109/ACCESS.2016.2632158
IEEE ACCESS
Keywords
Field
DocType
Distributed learning,information theoretic learning,semi-supervised learning,distance metric learning
Competitive learning,Online machine learning,Semi-supervised learning,Stability (learning theory),Instance-based learning,Active learning (machine learning),Computer science,Distributed algorithm,Unsupervised learning,Artificial intelligence,Machine learning
Journal
Volume
ISSN
Citations 
4
2169-3536
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Pengcheng Shen1504.47
Xin Du212726.78
Chunguang Li322816.58