Paper Info
Title
Robust and Reliable Feature Extractor Training by Using Unsupervised Pre-training with Self-Organization Map.
Abstract
Recent research has shown that deep neural network is very powerful for object recognition task. However, training the deep neural network with more than two hidden layers is not easy even now because of regularization problem. To overcome such a regularization problem, some techniques like dropout and de-noising were developed. The philosophy behind de-noising is to extract more robust features from the training data. For that purpose, randomly corrupted input data are used for training an auto-encoder or Restricted Boltzmann machine (RBM). In this paper, we propose unsupervised pre-training with a Self-Organization Map (SOM) to increase robustness and reliability of feature extraction. The basic idea is that instead of random corruption, our proposed algorithm works as a feature extractor so that corrupted input maintains the main skeleton or structure of original data. As a result, our proposed algorithm can extract more robust features related to input data.
Year
DOI
Venue
2014
10.1007/978-3-319-16841-8_16
ROBOT INTELLIGENCE TECHNOLOGY ANDAPPLICATIONS 3
Field
DocType
Volume
Restricted Boltzmann machine,Pattern recognition,Computer science,Self organization map,Robustness (computer science),Feature extraction,Regularization (mathematics),Artificial intelligence,Extractor,Artificial neural network,Machine learning,Cognitive neuroscience of visual object recognition
Conference
345
ISSN
Citations 
PageRank 
2194-5357
0
0.34
References 
Authors
5
2
Name
Order
Citations
PageRank
You-Min Lee100.68
Jong-Hwan Kim22494272.19