Title
Supervised Learning in SNN via Reward-Modulated Spike-Timing-Dependent Plasticity for a Target Reaching Vehicle.
Abstract
Spiking neural networks (SNNs) offer many advantages over traditional artificial neural networks (ANNs) such as biological plausibility, fast information processing, and energy efficiency. Although SNNs have been used to solve a variety of control tasks using the Spike-Timing-Dependent Plasticity (STDP) learning rule, existing solutions usually involve hard-coded network architectures solving specific tasks rather than solving different kinds of tasks generally. This results in neglecting one of the biggest advantages of ANNs, i.e., being general-purpose and easy-to-use due to their simple network architecture, which usually consists of an input layer, one or multiple hidden layers and an output layer. This paper addresses the problem by introducing an end-to-end learning approach of spiking neural networks constructed with one hidden layer and reward-modulated Spike-Timing-Dependent Plasticity (R-STDP) synapses in an all-to-all fashion. We use the supervised reward-modulated Spike-Timing-Dependent-Plasticity learning rule to train two different SNN-based sub-controllers to replicate a desired obstacle avoiding and goal approaching behavior, provided by pre-generated datasets. Together they make up a target-reaching controller, which is used to control a simulated mobile robot to reach a target area while avoiding obstacles in its path. We demonstrate the performance and effectiveness of our trained SNNs to achieve target reaching tasks in different unknown scenarios.
Year
DOI
Venue
2019
10.3389/fnbot.2019.00018
FRONTIERS IN NEUROROBOTICS
Keywords
Field
DocType
spiking neural network,R-STDP,supervised learning,end-to-end control,autonomous locomotion
Control theory,Computer science,Network architecture,Supervised learning,Learning rule,Artificial intelligence,Spike-timing-dependent plasticity,Spiking neural network,Artificial neural network,Mobile robot,Machine learning
Journal
Volume
ISSN
Citations 
13
1662-5218
1
PageRank 
References 
Authors
0.38
0
6
Name
Order
Citations
PageRank
Zhenshan Bing1175.51
Ivan Baumann210.38
Zhuangyi Jiang352.17
Kai Huang446845.69
Caixia Cai5285.15
Alois Knoll Knoll61700271.32