Title
Information Theoretic Self-organised Adaptation in Reservoirs for Temporal Memory Tasks.
Abstract
Recurrent neural networks of the Reservoir Computing (RC) type have been found useful in various time-series processing tasks with inherent non-linearity and requirements of temporal memory. Here with the aim to obtain extended temporal memory in generic delayed response tasks, we combine a generalised intrinsic plasticity mechanism with an information storage based neuron leak adaptation rule in a self-organised manner. This results in adaptation of neuron local memory in terms of leakage along with inherent homeostatic stability. Experimental results on two benchmark tasks confirm the extended performance of this system as compared to a static RC and RC with only intrinsic plasticity. Furthermore, we demonstrate the ability of the system to solve long temporal memory tasks via a simulated T-shaped maze navigation scenario.
Year
DOI
Venue
2012
10.1007/978-3-642-32909-8_4
Communications in Computer and Information Science
Keywords
Field
DocType
Recurrent neural networks,Self-adaptation,Information theory,Intrinsic plasticity
Information theory,Computer science,Recurrent neural network,Intrinsic plasticity,Information storage,Self adaptation,Artificial intelligence,Reservoir computing,Machine learning
Conference
Volume
ISSN
Citations 
311
1865-0929
2
PageRank 
References 
Authors
0.39
9
3
Name
Order
Citations
PageRank
Sakyasingha Dasgupta1666.01
Florentin Wörgötter21304119.30
Poramate Manoonpong39411.02