Title
A Generalized Hierarchical Multi-Latent Space Model for Heterogeneous Learning.
Abstract
In many real world applications such as image annotation, gene function prediction, and insider threat detection, the data collected from heterogeneous sources often exhibit multiple types of heterogeneity, such as task heterogeneity, view heterogeneity, and label heterogeneity. To address this problem, we propose a Hierarchical Multi-Latent Space (HiMLS) learning framework to jointly model the triple types of heterogeneity. The basic idea is to learn a hierarchical multi-latent space by which we can simultaneously leverage the task relatedness, view consistency and the label correlations to improve the learning performance. We first propose a multi-latent space approach to model the complex heterogeneity, which is then used as a building block to stack up a multi-layer structure in order to learn the hierarchical multi-latent space. In such a way, we can gradually learn the more abstract concepts in the higher level. We present two instantiated models of the generalized framework using different divergence measures. The two-phase learning algorithms are used to train the multi-layer models. We drive the multiplicative update rules for pre-training and fine-tuning in each model, and prove the convergence and correctness of the update methods. The effectiveness of the proposed approach is verified on various data sets.
Year
DOI
Venue
2016
10.1109/TKDE.2016.2611514
IEEE Trans. Knowl. Data Eng.
Keywords
Field
DocType
Correlation,Data models,Learning systems,Data mining,Feature extraction,Matrix decomposition,Encoding,Labeling
Data mining,Data modeling,Data set,Computer science,Correctness,Theoretical computer science,Artificial intelligence,Multi-task learning,Automatic image annotation,Insider threat,Feature extraction,Machine learning,Encoding (memory)
Journal
Volume
Issue
ISSN
28
12
1041-4347
Citations 
PageRank 
References 
0
0.34
34
Authors
4
Name
Order
Citations
PageRank
Pei Yang1162.26
Hasan Davulcu258486.85
Yada Zhu33910.49
Jingrui He497775.40