Title | ||
---|---|---|
Sensing aware dimensionality reduction for nearest neighbor classification of high dimensional signals |
Abstract | ||
---|---|---|
A successful approach to high-dimensional classification problems has been to couple nearest-neighbor classification with distance-preserving data dimensionality reduction via independent random projections. In many problems, however, the observed data is related to a natural set of latent variables through a non-trivial sensing process. A common approach in such cases is to either ignore the sensing process or to invert it and then proceed with dimensionality reduction and classifier design. Inversion can be costly and may be unnecessary if the end goal is classification. Rather than either ignoring sensing structure or using it for explicit inversion, we propose using “structured random projections” whose correlation explicitly accounts for the sensing structure. We show examples comparing the performance of independent random projections of observed data, independent random projections of reconstructed data, and our new structured random projections of observed data which demonstrate the benefits of our approach. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1109/SSP.2012.6319716 | Statistical Signal Processing Workshop |
Keywords | Field | DocType |
signal classification,classifier design,distance-preserving data dimensionality reduction,high dimensional signals,high-dimensional classification problems,independent random projections,latent variables,nearest neighbor classification,nontrivial sensing process,reconstructed data,sensing aware dimensionality reduction,sensing structure,structured random projections,Inverse Problems,Least-Squares,Machine Learning,Nearest Neighbor Classification,Random Projections,Tikhonov Regularization | Tikhonov regularization,k-nearest neighbors algorithm,Data modeling,Dimensionality reduction,Pattern recognition,Inversion (meteorology),Latent variable,Inverse problem,Artificial intelligence,Classifier (linguistics),Mathematics | Conference |
ISSN | ISBN | Citations |
pending E-ISBN : 978-1-4673-0181-7 | 978-1-4673-0181-7 | 0 |
PageRank | References | Authors |
0.34 | 6 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Zachary Sun | 1 | 0 | 0.34 |
W. Clem Karl | 2 | 224 | 35.45 |
Prakash Ishwar | 3 | 85 | 11.54 |
Venkatesh Saligrama | 4 | 1350 | 112.74 |