Title
Deep Neural Networks With Local Connectivity And Its Application To Astronomical Spectral Data
Abstract
The success of deep learning proves that deep models are able to achieve much better performance than shallow models in representation learning. However, deep neural networks with auto-encoder stacked structure suffer from low learning efficiency since common used training algorithms are variations of iterative algorithms based on the time-consuming gradient descent, especially when the network structure is complicated. To deal with this complicated network structure problem, we employ a "divide and conquer" strategy to design a locally connected network structure to decrease the network complexity. The basic idea of our approach is to force the basic units of the deep architecture, e.g., auto-encoders, to extract local features in an analytical way without iterative optimization and assemble these local features into a unified feature. We apply this method to process astronomical spectral data to illustrate the superiority of our approach over other baseline algorithms. Furthermore, we investigate visual interpretations of high level features and the model to demonstrate what exactly the model learn from the data.
Year
Venue
Field
2016
2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC)
Gradient descent,Network complexity,Algorithm design,Computer science,Deep belief network,Feature extraction,Artificial intelligence,Divide and conquer algorithms,Deep learning,Machine learning,Feature learning
DocType
ISSN
Citations 
Conference
1062-922X
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Ke Wang101.35
Ping Guo260185.05
Ali Luo354.76
Xin Xin441.74
Fuqing Duan516326.40