Paper Info
Title
Learning Feedforward and Recurrent Deterministic Spiking Neuron Network Feedback Controllers.
Abstract
We consider the problem of feedback control when the controller is constructed solely of deterministic spiking neurons. Although spiking neurons and networks have been the subject of several previous studies, analysis has primarily been restricted to a firing rate model. In contrast, we construct a spike timing based deterministic spiking neuron controller whose control output is one or multiple sparse spike trains. We model the problem formally as a hybrid dynamical system comprised of a closed loop between a plant and a spiking neuron network controller. The construction differs from classical controllers owing to the fact that the control feedback to the plant is generated by convolving the spike trains with fixed kernels, resulting in a highly constrained and stereotyped control signal. We derive a novel synaptic weight update rule via which the spiking neuron network controller to hold process variables at desired set points. We demonstrate the efficacy of the rule by applying it to the classical control problem of the cart-pole (inverted pendulum). Experiments demonstrate that the proposed controller has a larger region of stability as compared to the traditional PID controller, and its trajectories differ qualitatively from those of the PID controller. In addition, the proposed controller with a recurrent network generates sparse spike trains with rates as low as 1.99Hz.
Year
Venue
Field
2017
arXiv: Neurons and Cognition
Inverted pendulum,Control theory,PID controller,Control theory,Neuron,Network interface controller,Synaptic weight,Mathematics,Dynamical system,Feed forward
DocType
Volume
Citations 
Journal
abs/1708.02603
0
PageRank 
References 
Authors
0.34
10
2
Name
Order
Citations
PageRank
Tae Seung Kang150.78
Arunava Banerjee231329.18