Title
Sensing aware dimensionality reduction for nearest neighbor classification of high dimensional signals
Abstract
A successful approach to high-dimensional classification problems has been to couple nearest-neighbor classification with distance-preserving data dimensionality reduction via independent random projections. In many problems, however, the observed data is related to a natural set of latent variables through a non-trivial sensing process. A common approach in such cases is to either ignore the sensing process or to invert it and then proceed with dimensionality reduction and classifier design. Inversion can be costly and may be unnecessary if the end goal is classification. Rather than either ignoring sensing structure or using it for explicit inversion, we propose using “structured random projections” whose correlation explicitly accounts for the sensing structure. We show examples comparing the performance of independent random projections of observed data, independent random projections of reconstructed data, and our new structured random projections of observed data which demonstrate the benefits of our approach.
Year
DOI
Venue
2012
10.1109/SSP.2012.6319716
Statistical Signal Processing Workshop
Keywords
Field
DocType
signal classification,classifier design,distance-preserving data dimensionality reduction,high dimensional signals,high-dimensional classification problems,independent random projections,latent variables,nearest neighbor classification,nontrivial sensing process,reconstructed data,sensing aware dimensionality reduction,sensing structure,structured random projections,Inverse Problems,Least-Squares,Machine Learning,Nearest Neighbor Classification,Random Projections,Tikhonov Regularization
Tikhonov regularization,k-nearest neighbors algorithm,Data modeling,Dimensionality reduction,Pattern recognition,Inversion (meteorology),Latent variable,Inverse problem,Artificial intelligence,Classifier (linguistics),Mathematics
Conference
ISSN
ISBN
Citations 
pending E-ISBN : 978-1-4673-0181-7
978-1-4673-0181-7
0
PageRank 
References 
Authors
0.34
6
4
Name
Order
Citations
PageRank
Zachary Sun100.34
W. Clem Karl222435.45
Prakash Ishwar38511.54
Venkatesh Saligrama41350112.74