Title
Reservoir Computing On The Hypersphere
Abstract
Reservoir Computing (RC) refers to a Recurrent Neural Network (RNNs) framework, frequently used for sequence learning and time series prediction. The RC system consists of a random fixed-weight RNN (the input-hidden reservoir layer) and a classifier (the hidden-output readout layer). Here, we focus on the sequence learning problem, and we explore a different approach to RC. More specifically, we remove the nonlinear neural activation function, and we consider an orthogonal reservoir acting on normalized states on the unit hypersphere. Surprisingly, our numerical results show that the system's memory capacity exceeds the dimensionality of the reservoir, which is the upper bound for the typical RC approach based on Echo State Networks (ESNs). We also show how the proposed system can be applied to symmetric cryptography problems, and we include a numerical implementation.
Year
DOI
Venue
2017
10.1142/S0129183117500954
INTERNATIONAL JOURNAL OF MODERN PHYSICS C
Keywords
Field
DocType
Recurrent neural networks, reservoir computing, cryptography
Nonlinear system,Activation function,Upper and lower bounds,Algorithm,Recurrent neural network,Hypersphere,Curse of dimensionality,Reservoir computing,Sequence learning,Mathematics
Journal
Volume
Issue
ISSN
28
7
0129-1831
Citations 
PageRank 
References 
0
0.34
2
Authors
1
Name
Order
Citations
PageRank
Mircea Andrecut1738.52