Title
Simplifying convnets for fast learning
Abstract
In this paper, we propose different strategies for simplifying filters, used as feature extractors, to be learnt in convolutional neural networks (ConvNets) in order to modify the hypothesis space, and to speed-up learning and processing times. We study two kinds of filters that are known to be computationally efficient in feed-forward processing: fused convolution/sub-sampling filters, and separable filters. We compare the complexity of the back-propagation algorithm on ConvNets based on these different kinds of filters. We show that using these filters allows to reach the same level of recognition performance as with classical ConvNets for handwritten digit recognition, up to 3.3 times faster.
Year
DOI
Venue
2012
10.1007/978-3-642-33266-1_8
ICANN (2)
Keywords
Field
DocType
processing time,classical convnets,handwritten digit recognition,different strategy,back-propagation algorithm,feed-forward processing,convolutional neural network,fast learning,simplifying convnets,different kind,feature extractor,recognition performance
Pattern recognition,Convolution,Computer science,Convolutional neural network,Separable space,Artificial intelligence,Digit recognition,Machine learning
Conference
Citations 
PageRank 
References 
16
1.73
9
Authors
2
Name
Order
Citations
PageRank
Franck Mamalet130216.35
Christophe Garcia2353.12