Paper Info
Title
A Hebbian Feedback Covariance Learning Paradigm For Self-Tuning Optimal Control
Abstract
We propose a novel adaptive optimal control paradigm inspired by Hebbian covariance synaptic adaptation, a preeminent model of learning and memory as well as other malleable functions in the brain. The adaptation is driven by the spontaneous fluctuations in the system input and output, the covariance of which provides useful information about the changes in the system behavior. The control structure represents a novel form of associative reinforcement learning in which the reinforcement signal is implicitly given by the covariance of the input-output (I/O) signals. Theoretical foundations for the paradigm are derived using Lyapunov theory and are verified by means of computer simulations. The learning algorithm is applicable to a general class of nonlinear adaptive control problems, This on-line direct adaptive control method benefits from a computationally straightforward design, proof of convergence, no need for complete system identification, robustness to noise and uncertainties, and the ability to optimize a general performance criterion in terms of system states and control signals. These attractive properties of Hebbian feedback covariance learning control lend themselves to future investigations into the computational functions of synaptic plasticity in biological neurons.
Year
DOI
Venue
2001
10.1109/3477.915341
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS
Keywords
Field
DocType
adaptive optimal control, feedback covariance adaptation, Hebbian learning, intelligient control, self-tuning optimal control, synaptic plasticity
Competitive learning,Optimal control,Computer science,Control theory,Hebbian theory,Self-tuning,Artificial intelligence,Adaptive control,Machine learning,Leabra,Covariance,Reinforcement learning
Journal
Volume
Issue
ISSN
31
2
1083-4419
Citations 
PageRank 
References 
2
0.44
7
Authors
2
Name
Order
Citations
PageRank
D. L. Young1164.59
Chi-Sang Poon25410.88