Title
A Novel GPU-Based Efficient Approach for Convolutional Neural Networks with Small Filters.
Abstract
In recent years, convolutional neural networks (CNNs) as important parts of deep neural networks (DNNs) have achieved great successes in the field of computer vision. However, Convolution always takes much computation time in the DNNs. In order to improve the efficiency of CNNs, many solutions focusing on training algorithms and parallelism strategies have been proposed. In this paper, different from traditional GPU-based algorithms, a novel algorithm based on look-up table is proposed to speed up the CNNs with small filters by applying GPU. By transforming complex matrix multiplications operations in the convolution computation to some table-based simple summation operations, the overhead of convolution computation can be considerably reduced. The process of creating a table and looking up values in the table is very appropriate for parallelization on a GPU. The experimental results show that the proposed approach can improve the speed of convolution computation by 20---30 %, compared with existing state-of-the-art works with less accuracy loss.
Year
DOI
Venue
2017
10.1007/s11265-016-1129-2
Signal Processing Systems
Keywords
Field
DocType
Deep neural networks,Convolutional neural network,Parallel computation,GPU
Complex matrix,Computer science,Convolutional neural network,Convolution,Parallel computing,Artificial intelligence,Deep neural networks,Machine learning,Computation,Speedup
Journal
Volume
Issue
ISSN
86
2-3
1939-8018
Citations 
PageRank 
References 
1
0.36
11
Authors
5
Name
Order
Citations
PageRank
Wenbin Jiang172.90
Yiming Chen2519.12
Hai Jin36544644.63
Ran Zheng420625.05
Ye Chi561.83