Title
Filter Level Pruning Based On Similar Feature Extraction For Convolutional Neural Networks
Abstract
This paper introduces a filter level pruning method based on similar feature extraction for compressing and accelerating the convolutional neural networks by k-means++ algorithm. In contrast to other pruning methods, the proposed method would analyze the similarities in recognizing features among filters rather than evaluate the importance of filters to prune the redundant ones. This strategy would be more reasonable and effective. Furthermore, our method does not result in unstructured network. As a result, it needs not extra sparse representation and could be efficiently supported by any off-the-shelf deep learning libraries. Experimental results show that our filter pruning method could reduce the number of parameters and the amount of computational costs in Lenet-5 by a factor of 17.9x with only 0.3% accuracy loss.
Year
DOI
Venue
2018
10.1587/transinf.2017EDL8248
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS
Keywords
Field
DocType
CNNs, filter, pruning, feature extraction, k-means plus, structured
Pattern recognition,Computer science,Convolutional neural network,Feature extraction,Artificial intelligence,Pruning
Journal
Volume
Issue
ISSN
E101D
4
1745-1361
Citations 
PageRank 
References 
2
0.40
0
Authors
3
Name
Order
Citations
PageRank
Lianqiang Li122.43
Yuhui Xu2125.00
Jie Zhu320728.62