Title
Dot-product engine for neuromorphic computing: programming 1T1M crossbar to accelerate matrix-vector multiplication.
Abstract
Vector-matrix multiplication dominates the computation time and energy for many workloads, particularly neural network algorithms and linear transforms (e.g, the Discrete Fourier Transform). Utilizing the natural current accumulation feature of memristor crossbar, we developed the Dot-Product Engine (DPE) as a high density, high power efficiency accelerator for approximate matrix-vector multiplication. We firstly invented a conversion algorithm to map arbitrary matrix values appropriately to memristor conductances in a realistic crossbar array, accounting for device physics and circuit issues to reduce computational errors. The accurate device resistance programming in large arrays is enabled by close-loop pulse tuning and access transistors. To validate our approach, we simulated and benchmarked one of the state-of-the-art neural networks for pattern recognition on the DPEs. The result shows no accuracy degradation compared to software approach (99 % pattern recognition accuracy for MNIST data set) with only 4 Bit DAC/ADC requirement, while the DPE can achieve a speed-efficiency product of 1,000× to 10,000× compared to a custom digital ASIC.
Year
DOI
Venue
2016
10.1145/2897937.2898010
DAC
Keywords
Field
DocType
dot-product engine,neuromorphic computing,1T1M crossbar programming,matrix-vector multiplication,vector-matrix multiplication,neural network algorithms,discrete Fourier transform,memristor crossbar,DPE,memristor conductances,crossbar array,device resistance programming,close-loop pulse tuning,pattern recognition,custom digital ASIC
Memristor,Computer science,Neuromorphic engineering,Electronic engineering,Multiplication,Dot product,Discrete Fourier transform,Artificial neural network,Matrix multiplication,Crossbar switch
Conference
ISBN
Citations 
PageRank 
978-1-4673-8730-9
48
1.74
References 
Authors
8
10
Name
Order
Citations
PageRank
Miao Hu145931.50
John Paul Strachan228017.84
Li Zhiyong311220.76
Emmanuelle M. Grafals4481.74
Noraica Davila5542.53
Catherine Graves6523.86
Sity Lam7492.11
ning849661.98
Jianhua Joshua Yang9493.10
R. Stanley Williams1086190.61