Title
Learning Versatile Filters for Efficient Convolutional Neural Networks.
Abstract
This paper introduces versatile filters to construct efficient convolutional neural network. Considering the demands of efficient deep learning techniques running on cost-effective hardware, a number of methods have been developed to learn compact neural networks. Most of these works aim to slim down filters in different ways, e.g. investigating small, sparse or binarized filters. In contrast, we treat filters from an additive perspective. A series of secondary filters can be derived from a primary filter. These secondary filters all inherit in the primary filter without occupying more storage, but once been unfolded in computation they could significantly enhance the capability of the filter by integrating information extracted from different receptive fields. Besides spatial versatile filters, we additionally investigate versatile filters from the channel perspective. The new techniques are general to upgrade filters in existing CNNs. Experimental results on benchmark datasets and neural networks demonstrate that CNNs constructed with our versatile filters are able to achieve comparable accuracy as that of original filters, but require less memory and FLOPs.
Year
Venue
Keywords
2018
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018)
neural networks,convolutional neural networks,experimental results,receptive fields,different ways,the techniques
Field
DocType
Volume
Convolutional neural network,FLOPS,Computer science,Communication channel,Upgrade,Artificial intelligence,Deep learning,Artificial neural network,Computer engineering,Machine learning,Computation
Conference
31
ISSN
Citations 
PageRank 
1049-5258
3
0.38
References 
Authors
0
5
Name
Order
Citations
PageRank
Yunhe Wang111322.76
Chang Xu278147.60
Chunjing Xu36116.98
Chao Xu4132762.65
Dacheng Tao519032747.78