Title
Towards Budget-Driven Hardware Optimization for Deep Convolutional Neural Networks Using Stochastic Computing
Abstract
Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant increases in computation complexity. Largescale deep learning systems mainly operate in high-performance server clusters, thus restricting the application extensions to personal or mobile devices. Previous works on GPU and/or FPGA acceleration for DCNNs show increasing speedup, but ignore other constraints, such as area, power, and energy. Stochastic Computing (SC), as a unique data representation and processing technique, has the potential to enable the design of fully parallel and scalable hardware implementations of large-scale deep learning systems. This paper proposed an automatic design allocation algorithm driven by budget requirement considering overall accuracy performance. This systematic method enables the automatic design of a DCNN where all design parameters are jointly optimized. Experimental results demonstrate that proposed algorithm can achieve a joint optimization of all design parameters given the comprehensive budget of a DCNN.
Year
DOI
Venue
2018
10.1109/ISVLSI.2018.00016
2018 IEEE Computer Society Annual Symposium on VLSI (ISVLSI)
Keywords
DocType
Volume
Deep Learning,Deep Convolutional Neural Networks,Stochastic Computing,Design Parameter Co optimization
Conference
abs/1805.04142
ISSN
ISBN
Citations 
2159-3469
978-1-5386-7100-9
0
PageRank 
References 
Authors
0.34
17
8
Name
Order
Citations
PageRank
zhe li1827.50
Ji Li29710.87
Ao Ren39611.53
Caiwen Ding414226.52
Jeff Draper529826.31
Qinru Qiu61120102.58
Bo Yuan726228.64
Yanzhi Wang81082136.11