Title
A heuristic approach to the hyperparameters in training spiking neural networks using spike-timing-dependent plasticity
Abstract
The third type of neural network called spiking is developed due to a more accurate representation of neuronal activity in living organisms. Spiking neural networks have many different parameters that can be difficult to adjust manually to the current classification problem. The analysis and selection of coefficients’ values in the network can be analyzed as an optimization problem. A practical method for automatic selection of them can decrease the time needed to develop such a model. In this paper, we propose the use of a heuristic approach to analyze and select coefficients with the idea of collaborative working. The proposed idea is based on parallel analyzing of different coefficients and choosing the best of them or average ones. This type of optimization problem allows the selection of all variables, which can significantly affect the convergence of the accuracy. Our proposal was tested using network simulators and popular databases to indicate the possibilities of the described approach. Five different heuristic algorithms were tested and the best results were reached by Cuckoo Search Algorithm, Grasshopper Optimization Algorithm, and Polar Bears Algorithm.
Year
DOI
Venue
2022
10.1007/s00521-021-06824-8
Neural Computing and Applications
Keywords
DocType
Volume
Spiking neural network, Heuristic, Hyperparameters, Federated learning, Image processing
Journal
34
Issue
ISSN
Citations 
16
0941-0643
1
PageRank 
References 
Authors
0.36
19
4
Name
Order
Citations
PageRank
Dawid Polap110.70
Marcin Wozniak23613.22
Waldemar Holubowski310.36
Robertas Damasevicius420.73