Name
Abstract | ||
|---|---|---|
A Spiking Neural Network (SNN) training using SpikeProp and its variants is usually affected by sudden rise in learning cost called surges. These surges cause diversion in the learning process and often cause it to fail as well. Researches have shown that proper learning rate is crucial to avoid these surges. In this paper, we perform weight convergence analysis to determine the proper step size in each iteration of weight update and derive an adaptive learning rate extension to SpikeProp that assures convergence of the learning process. We have analyzed the performance of this learning rate adaptation with existing methods via simulations on different benchmarks. The results show that using adaptive learning rate significantly improves the weight convergence and speeds up learning as well. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1016/j.neunet.2014.12.001 | Neural Networks |
Keywords | Field | DocType |
Spiking Neural Network (SNN),Weight convergence,Supervised learning,SpikeProp,Adaptive learning rate | Convergence (routing),Computer science,Supervised learning,Artificial intelligence,Adaptive learning rate,Spiking neural network,Machine learning | Journal |
Volume | Issue | ISSN |
63 | 1 | 0893-6080 |
Citations | PageRank | References |
15 | 0.64 | 28 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Sumit Bam Shrestha | 1 | 49 | 3.64 |
| Q. Song | 2 | 65 | 6.02 |