Title
Self-Organizing Maps and Scale-Invariant Maps in Echo State Networks
Abstract
In the last years a new approach for designing and training artificial Recurrent Neural Network (RNN) have been investigated under the name of Reservoir Computing (RC). One important model in the field of RC has been developed under the name of Echo State Networks (ESNs). Traditionally, an ESN uses a RNN with random untrained parameters called the reservoir. The Self-Organizing Map (SOM) and the Scale Invariant Map (SIM) are two methods of topographic maps which have been used in different tasks of unsupervised learning. Recently, new works show that is effective using the SOM to set values of the reservoir parameters. The primary goal of this work is to improve the performance of ESN using the another method SIM. Here, we present the description of these two topographic map methods and the way to apply its on the ESN initialization. We specify an original algorithm to set the reservoir weights using the SOM and SIM. Furthermore, we use artificial data set to compare the use of topographic maps to initialize the ESN with random initialization. Overall, our results show the aptitude of SIM and SOM to set the reservoir parameters.
Year
DOI
Venue
2011
10.1109/ISDA.2011.6121637
Intelligent Systems Design and Applications
Keywords
Field
DocType
recurrent neural nets,self-organising feature maps,unsupervised learning,artificial recurrent neural network training,echo state network,random untrained parameter,reservoir computing,scale-invariant maps,self-organizing maps,topographic maps,unsupervised learning,Echo State Networks,Reservoir Computing,Scale Invariant Maps,Self-Organizing Maps,Times Series Prediction,Topographic Maps
Recurrent neural nets,Scale invariance,Pattern recognition,Topographic map,Computer science,Recurrent neural network,Self-organizing map,Unsupervised learning,Reservoir computing,Artificial intelligence,Initialization,Machine learning
Conference
ISSN
ISBN
Citations 
2164-7143
978-1-4577-1676-8
14
PageRank 
References 
Authors
0.86
4
3
Name
Order
Citations
PageRank
Sebastián Basterrech1140.86
Colin Fyfe250855.62
Gerardo Rubino3141.88