Title
A novel autoencoder approach to feature extraction with linear separability for high-dimensional data
Abstract
Feature extraction often needs to rely on sufficient information of the input data, however, the distribution of the data upon a high-dimensional space is too sparse to provide sufficient information for feature extraction. Furthermore, high dimensionality of the data also creates trouble for the searching of those features scattered in subspaces. As such, it is a tricky task for feature extraction from the data upon a high-dimensional space. To address this issue, this article proposes a novel autoencoder method using Mahalanobis distance metric of rescaling transformation. The key idea of the method is that by implementing Mahalanobis distance metric of rescaling transformation, the difference between the reconstructed distribution and the original distribution can be reduced, so as to improve the ability of feature extraction to the autoencoder. Results show that the proposed approach wins the state-of-the-art methods in terms of both the accuracy of feature extraction and the linear separabilities of the extracted features. We indicate that distance metric-based methods are more suitable for extracting those features with linear separabilities from high-dimensional data than feature selection-based methods. In a high-dimensional space, evaluating feature similarity is relatively easier than evaluating feature importance, so that distance metric methods by evaluating feature similarity gain advantages over feature selection methods by assessing feature importance for feature extraction, while evaluating feature importance is more computationally efficient than evaluating feature similarity.
Year
DOI
Venue
2022
10.7717/peerj-cs.1061
PEERJ COMPUTER SCIENCE
Keywords
DocType
Volume
Autoencoder, Distance metric, Feature extraction
Journal
8
ISSN
Citations 
PageRank 
2376-5992
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Jian Zheng1233.19
Hongchun Qu200.34
Zhaoni Li300.34
Lin Li432379.92
Xiaoming Tang500.34
Fei Guo600.34