Paper Info
Title
A Decomposable Winograd Method For N-D Convolution Acceleration In Video Analysis
Abstract
Winograd's minimal filtering algorithm has been widely used in 2-D Convolutional Neural Networks (CNNs) to reduce the number of multiplications for faster processing. However, it is only effective on convolutions with kernel size as 3 and stride as 1, because it suffers from significantly increased FLOPs and numerical accuracy problems for kernel size larger than 3 and fails on convolution with stride larger than 1. Worse, the extension to N-D convolution will intensify the numerical accuracy problem. These problems severely obstruct Winograd's minimal filtering algorithm's application to video analysis. In this paper, we propose a novel Decomposable Winograd Method (DWM) for the N-D convolution acceleration, which breaks through the limitation of original Winograd's minimal filtering algorithm to more general convolutions. DWM decomposes kernels with large size or stride>1 to several small kernels with stride as 1 for further applying Winograd algorithm, so that DWMcan reduce the number of multiplications while keeping the numerical accuracy. It enables the fast exploration of larger kernel size, larger stride value, and higher dimensions in CNNs for high performance and accuracy and even the potential for new CNNs. Comparing against the original Winograd algorithm, the proposed DWM is able to support all kinds of N-D convolutions with a speedup of 1.44x-3.38x, without affecting the numerical accuracy.
Year
DOI
Venue
2021
10.1007/s11263-021-01500-9
INTERNATIONAL JOURNAL OF COMPUTER VISION
Keywords
DocType
Volume
Convolution neural networks, Model acceleration, Winograd algorithm, Video analysis
Journal
129
Issue
ISSN
Citations 
10
0920-5691
0
PageRank 
References 
Authors
0.34
0
9
Name
Order
Citations
PageRank
Di Huang100.68
Rui Zhang238186.83
Xishan Zhang3362.23
Wu Fan41731192.15
Xianzhuo Wang500.34
Pengwei Jin600.68
Shaoli Liu756027.88
Ling Li8495.85
Yunji Chen9143279.99