Title
A General Exponential Framework for Dimensionality Reduction
Abstract
As a general framework, Laplacian embedding, based on a pairwise similarity matrix, infers low dimensional representations from high dimensional data. However, it generally suffers from three issues: 1) algorithmic performance is sensitive to the size of neighbors; 2) the algorithm encounters the well known small sample size (SSS) problem; and 3) the algorithm de-emphasizes small distance pairs. To address these issues, here we propose exponential embedding using matrix exponential and provide a general framework for dimensionality reduction. In the framework, the matrix exponential can be roughly interpreted by the random walk over the feature similarity matrix, and thus is more robust. The positive definite property of matrix exponential deals with the SSS problem. The behavior of the decay function of exponential embedding is more significant in emphasizing small distance pairs. Under this framework, we apply matrix exponential to extend many popular Laplacian embedding algorithms, e.g., locality preserving projections, unsupervised discriminant projections, and marginal fisher analysis. Experiments conducted on the synthesized data, UCI, and the Georgia Tech face database show that the proposed new framework can well address the issues mentioned above.
Year
DOI
Venue
2014
10.1109/TIP.2013.2297020
IEEE Transactions on Image Processing
Keywords
DocType
Volume
positive definite property,decay function,georgia tech face database,small sample size,face recognition,visual databases,matrix algebra,dimensionality reduction,unsupervised discriminant projections,general exponential framework,laplacian embedding,marginal fisher analysis,matrix exponential,data handling,laplacian embedding algorithms,manifold learning,pairwise similarity matrix,sss problem,algorithmic performance
Journal
23
Issue
ISSN
Citations 
2
1057-7149
25
PageRank 
References 
Authors
0.77
20
5
Name
Order
Citations
PageRank
Sujing Wang169037.65
Shuicheng Yan2197074.15
Jian Yang36102339.77
Chunguang Zhou454352.37
Xiaolan Fu578660.72