Paper Info
Title
Enhanced Spiking Neural Network with forgetting phenomenon based on electronic synaptic devices
Abstract
Forgetting is an essential phenomenon in human brain to help people get away from chaos. Such phenomenon could be emulated in the electronic synaptic device, which is the critical unit for hardware implementation of Spiking Neural Network (SNN). To the best of our knowledge, however, forgetting phenomenon has rarely been applied in weights update of traditional SNNs based on spike-timing-dependent plasticity (STDP). In this work, we propose a novel SNN training algorithm using forgetting phenomenon. The weights update procedures are composed of potentiation and forgetting, and implemented by single-polarity pulses and time intervals between training samples. Benchmarked with the MNIST handwriting dataset, we demonstrate the algorithm’s performance by a single-layer perceptron with 784  ×  10 synapses. Besides, the influence of some non-ideal factors are taken into consideration to analyze the robust performance of enhanced SNN. The simulation result indicates the proposed SNN with forgetting phenomenon exhibits faster convergence speed and higher recognition rate (88.07%) than traditional SNN with similar network scale. Moreover, it shows a good tolerance to the non-linear conductance response and variation while it has less endurance requirement of electronic synaptic devices.
Year
DOI
Venue
2020
10.1016/j.neucom.2019.09.030
Neurocomputing
Keywords
DocType
Volume
Forgetting,Spiking Neural Network,Spike-timing-dependent plasticity,Electronic synaptic devices,MNIST,Non-ideality
Journal
408
ISSN
Citations 
PageRank 
0925-2312
1
0.36
References 
Authors
0
8
Name
Order
Citations
PageRank
Jiwei Li122.40
Hui Xu2127.67
Shengyang Sun323.75
Sen Liu412.39
Nan Li52828.52
Qingjiang Li621.40
Haijun Liu724.43
Zhiwei Li81315107.73