Title
Mitigating Effects of Non-ideal Synaptic Device Characteristics for On-chip Learning
Abstract
The cross-point array architecture with resistive synaptic devices has been proposed for on-chip implementation of weighted sum and weight update in the training process of learning algorithms. However, the non-ideal properties of the synaptic devices available today, such as the nonlinearity in weight update, limited ON/OFF range and device variations, can potentially hamper the learning accuracy. This paper focuses on the impact of these realistic properties on the learning accuracy and proposes the mitigation strategies. Unsupervised sparse coding is selected as a case study algorithm. With the calibration of the realistic synaptic behavior from the measured experimental data, our study shows that the recognition accuracy of MNIST handwriting digits degrades from ~97 % to ~65 %. To mitigate this accuracy loss, the proposed strategies include 1) the smart programming schemes for achieving linear weight update; 2) a dummy column to eliminate the off-state current; 3) the use of multiple cells for each weight element to alleviate the impact of device variations. With the improved synaptic behavior by these strategies, the accuracy increases back to ~95 %, enabling the reliable integration of realistic synaptic devices in the neuromorphic systems.
Year
DOI
Venue
2015
10.1109/ICCAD.2015.7372570
International Conference on Computer-Aided Design
Keywords
Field
DocType
machine learning,neuromorphic computing,cross-point array,resistive memory,synaptic device
Nonlinear system,System on a chip,MNIST database,Computer science,Neural coding,Support vector machine,Neuromorphic engineering,Electronic engineering,Encoding (memory),Resistive random-access memory
Conference
ISSN
ISBN
Citations 
1933-7760
978-1-4673-8389-9
12
PageRank 
References 
Authors
0.67
8
9
Name
Order
Citations
PageRank
Pai-Yu Chen1211.32
Lin, Binbin2666.41
I.-Ting Wang3191.81
Tuo-Hung Hou4234.92
Jieping Ye56943351.37
Sarma Vrudhula62380180.63
Jae-sun Seo753656.32
Yu Cao832929.78
Shimeng Yu949056.22