Title
Supervised Dimensionality Reduction via Nonlinear Target Estimation
Abstract
Dimensionality reduction is a crucial ingredient of machine learning and data mining, boosting classification accuracy through the isolation of patterns via omission of noise. Nevertheless, recent studies have shown that dimensionality reduction can benefit from label information, via a joint estimation of predictors and target variables from a low-rank representation. In the light of such inspiration, we propose a novel dimensionality reduction which simultaneously reconstructs the predictors using matrix factorization and estimates the target variable via a dual-form maximum margin classifier from the latent space. The joint optimization function is learned through a coordinate descent algorithm via stochastic updates. Finally empirical results demonstrate the superiority of the proposed method compared to both classification in the original space no reduction, or classification after unsupervised reduction.
Year
DOI
Venue
2013
10.1007/978-3-642-40131-2_15
DaWaK
Keywords
Field
DocType
machine learning,dimensionality reduction,matrix factorization,feature extraction
Data mining,Dimensionality reduction,Pattern recognition,Computer science,Matrix decomposition,Feature extraction,Boosting (machine learning),Artificial intelligence,Coordinate descent,Diffusion map,Margin classifier,Linear classifier
Conference
Citations 
PageRank 
References 
0
0.34
17
Authors
3
Name
Order
Citations
PageRank
Josif Grabocka110614.69
Lucas Drumond239524.27
Lars Schmidt-Thieme33802216.58