Title
Doubly supervised embedding based on class labels and intrinsic clusters for high-dimensional data visualization.
Abstract
Visualization of data can assist decision-making processes by presenting the underlying information in a perceptible manner. Many dimension reduction techniques have been proposed to generate faithful visualization snapshots given high-dimensional data. When class labels associated with the data are already provided, supervised dimension reduction methods, which utilize such pre-given label information as well as the data, have been effective in revealing the overall structure of data with respect to their pre-given class labels. However, the main principle of most of these supervised methods has been to enhance class separability, which generally leads to significant distortion of original relationships. To compensate for such distortion, we propose a novel doubly supervised dimension reduction approach that highlights both natural groupings conforming to original relationships and classes determined by pre-given labels. Our method imposes minimal supervision on the pre-given class information depending on their original distributions while imposing additional supervision on natural groupings to better preserve them in reduced feature space. Specifically, we apply the notion of doubly supervised dimension reduction to a state-of-the-art method called t-distributed stochastic neighbor embedding and present a new formulation and an algorithm. By performing both quantitative and qualitative analyses, we demonstrate the effectiveness of our method using various visualization examples on real-world data. Our results show that, compared to other existing methods, the proposed method better preserves the original high-dimensional relationships while simultaneously maintaining class separability and preserving cluster structures. In addition, due to the characteristics of preserving natural groupings, the visualization results generated by our method reveal interesting sub-groups that cohesively preserve the original relationships in the data.
Year
DOI
Venue
2015
10.1016/j.neucom.2014.09.064
Neurocomputing
Keywords
Field
DocType
Supervised dimension reduction,Multidimensional projection,T-distributed stochastic neighbor embedding,Visualization,Scatter plot,Clustering
Data mining,Dimensionality reduction,Artificial intelligence,Cluster analysis,Distortion,t-distributed stochastic neighbor embedding,Feature vector,Embedding,Pattern recognition,Visualization,Scatter plot,Machine learning,Mathematics
Journal
Volume
ISSN
Citations 
150
0925-2312
3
PageRank 
References 
Authors
0.40
16
4
Name
Order
Citations
PageRank
Hannah Kim11036.77
Jaegul Choo255646.81
Chandan K. Reddy380373.50
Haesun Park43546232.42