Title
Fast Training of Convolutional Networks through FFTs.
Abstract
Convolutional networks are one of the most widely employed architectures in computer vision and machine learning. In order to leverage their ability to learn complex functions, large amounts of data are required for training. Training a large convolutional network to produce state-of-the-art results can take weeks, even when using modern GPUs. Producing labels using a trained network can also be costly when dealing with web-scale datasets. In this work, we present a simple algorithm which accelerates training and inference by a significant factor, and can yield improvements of over an order of magnitude compared to existing state-of-the-art implementations. This is done by computing convolutions as pointwise products in the Fourier domain while reusing the same transformed feature map many times. The algorithm is implemented on a GPU architecture and addresses a number of related challenges.
Year
Venue
Field
2013
international conference on learning representations
Computer science,Inference,Convolution,Reuse,Implementation,Fourier transform,Artificial intelligence,SIMPLE algorithm,Machine learning,Pointwise
DocType
Volume
Citations 
Journal
abs/1312.5851
12
PageRank 
References 
Authors
2.67
5
3
Name
Order
Citations
PageRank
Michaël Mathieu11915151.59
Mikael Henaff227212.83
Yann LeCun3260903771.21