Title
Low power Convolutional Neural Networks on a chip
Abstract
Deep learning, and especially Convolutional Neural Network (CNN, is among the most powerful and widely used techniques in computer vision. Applications range from image classification to object detection, segmentation, Optical Character Recognition (OCR), etc. At the same time, CNNs are both computationally intensive and memory intensive, making them difficult to be deployed on low power lightweight embedded systems. In this work, we introduce an on-chip convoltional neural network implementation for low-power embedded system. We point out that the high precision of weights limits the low-power CNN implementation on both FPGA and RRAM platform. A dynamic quantization method is introduced to reduce the precision while maintaining the same or comparable accuracy at the same time. Finally, the de ailed designs of low-power FPGA-based CNN and RRAM-based CNN are provided and compared. The results show that FPGA-based design gets 2× energy efficiency compared with GPU implementation, and toe RRAM-based design can further obtain more than 40× energy efficiency gains.
Year
DOI
Venue
2016
10.1109/ISCAS.2016.7527187
2016 IEEE International Symposium on Circuits and Systems (ISCAS)
Keywords
Field
DocType
convolutional neural networks on a chip,low-power CNN implementation,computer vision,RRAM-based design,GPU implementation,energy efficiency,FPGA-based design,RRAM-based CNN,FPGA-based CNN,field programmable gate arrays,dynamic quantization method,on-chip convoltional neural network implementation,low power lightweight embedded systems,OCR,optical character recognition,object detection,image classification
Object detection,Efficient energy use,Computer science,Convolutional neural network,Optical character recognition,Field-programmable gate array,Electronic engineering,Artificial intelligence,Deep learning,Artificial neural network,Contextual image classification
Conference
ISSN
ISBN
Citations 
0271-4302
978-1-4799-5342-4
4
PageRank 
References 
Authors
0.42
7
7
Name
Order
Citations
PageRank
Yu Wang12279211.60
Lixue Xia218215.55
Tianqi Tang334219.66
Boxun Li457131.13
Song Yao543821.18
Ming Cheng633947.21
Huazhong Yang72239214.90