Title
Merging Neurons For Structure Compression Of Deep Networks
Abstract
Deep neural networks are increasingly used in many fields, such as pattern recognition, computer vision, and natural language processing. However, how to apply deep neural networks in mobile settings has become an urgent issue, as mobile devices are getting more and more popularity. This is mainly due to the fact that mobile devices usually have very limited computation and storage resources, which prevents from running a large-scale deep network. This paper proposes a novel method for structure compression of deep neural networks. The main idea is to merge the neurons and connections of the original network using clustering methods. To the end, the new network after compression possesses much less parameters, which leads to reduced requirements for computation and storage resources. Experiments on benchmark data sets demonstrate that the proposed method can greatly improve the efficiency of deep neural networks, while retain their learning capability.
Year
DOI
Venue
2018
10.1109/ICPR.2018.8545107
2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR)
Field
DocType
ISSN
Pattern recognition,Computer science,Matrix decomposition,Mobile device,Artificial intelligence,Artificial neural network,Cluster analysis,Merge (version control),Deep neural networks,Computation,Distributed computing
Conference
1051-4651
Citations 
PageRank 
References 
0
0.34
0
Authors
3
Name
Order
Citations
PageRank
Guoqiang Zhong1163.78
Hui Yao200.68
Huiyu Zhou31303111.91