Title
A new algorithm for training sparse autoencoders.
Abstract
Data representation plays an important role in performance of machine learning algorithms. Since data usually lacks the desired quality, many efforts have been made to provide a more desirable representation of data. Among many different approaches, sparse data representation has gained popularity in recent years. In this paper, we propose a new sparse autoencoder by imposing the power two of smoothed L0 norm of data representation on the hidden layer of regular autoencoder. The square of smoothed L0 norm increases the tendency that each data representation is "individually" sparse. Moreover, by using the proposed sparse autoencoder, once the model parameters are learned, the sparse representation of any new data is obtained simply by a matrix-vector multiplication without performing any optimization. When applied to the MNIST, CIFAR-10, and OPTDIGITS datasets, the results show that the proposed model guarantees a sparse representation for each input data which leads to better classification results.
Year
Venue
Field
2017
European Signal Processing Conference
MNIST database,K-SVD,Computer science,Artificial intelligence,Sparse matrix,Autoencoder,External Data Representation,Pattern recognition,Sparse approximation,Algorithm,Feature extraction,Machine learning,Encoding (memory)
DocType
ISSN
Citations 
Conference
2076-1465
0
PageRank 
References 
Authors
0.34
15
5
Name
Order
Citations
PageRank
Ali Shahin Shamsabadi1215.12
Massoud Babaie-Zadeh291266.33
Seyyede Zohreh Seyyedsalehi300.34
Hamid R. Rabiee433641.77
Christian Jutten52925439.04