Title
Robust Deep Reservoir Computing Through Reliable Memristor With Improved Heat Dissipation Capability
Abstract
Deep neural networks (DNNs), a brain-inspired learning methodology, requires tremendous data for training before performing inference tasks. The recent studies demonstrate a strong positive correlation between the inference accuracy and the size of the DNNs and datasets, which leads to an inevitable demand for large DNNs. However, conventional memory techniques are not adequate to deal with the drastic growth of dataset and neural network size. Recently, a resistive memristor has been widely considered as the next generation memory device owing to its high density and low power consumption. Nevertheless, its high switching resistance variations (cycle-to-cycle) restrict its feasibility in deep learning. In this work, a novel memristor configuration with the enhanced heat dissipation feature is fabricated and evaluated to address this challenge. Our experimental results demonstrate our memristor reduces the resistance variation by ~ 30% and the inference accuracy increases correspondingly in a similar range. The accuracy increment is evaluated by our deep delay-feed-back reservoir computing (Deep-DFR) model. The design area, power consumption, and latency are reduced by ~48%, ~42%, and ~67%, respectively, compared to the conventional static random-access memory technique (6T). The performance of our memristor is improved at various degrees (~13%-73%) compared to the state-of-the-art memristors.
Year
DOI
Venue
2021
10.1109/TCAD.2020.3002539
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Keywords
DocType
Volume
Artificial neural networks,deep delay-feed-back reservoir computing (Deep-DFR),memristor,reservoir computing
Journal
40
Issue
ISSN
Citations 
3
0278-0070
2
PageRank 
References 
Authors
0.36
0
5
Name
Order
Citations
PageRank
Hongyu An15912.61
Mohammad Shah Al-Mamun220.36
Marius K. Orlowski320.36
Lingjia Liu479992.58
Yang Yi515926.70