Paper Info
Title
Rapid learning in sequential composition control
Abstract
Sequential composition is an effective approach to address the control of complex dynamical systems. However, it is not designed to cope with unforeseen situations that might occur during runtime. This paper extends sequential composition control via learning new policies. A learning module based on reinforcement learning is added to the traditional sequential composition that allows for the online creation of new control policies in a short amount of time, on a need basis. During learning, the domain of attraction (DOA) of the new control policy is continuously monitored. Hence, the learning process only executes until the supervisor is able to compose the new control policy with designed controllers via the overlap of DOAs. Estimating the DOAs of the learned controllers is achieved by solving an optimization problem. The proposed strategy has been simulated on a nonlinear system. The results show that the learning module can rapidly augment the designed sequential composition by new control policies such that the supervisor could handle unpredicted situations online.
Year
DOI
Venue
2014
10.1109/CDC.2014.7040197
Decision and Control
Keywords
Field
DocType
large-scale systems,learning (artificial intelligence),nonlinear systems,optimisation,DOA,complex dynamical systems,domain of attraction,learning module,nonlinear system,optimization problem,rapid learning,reinforcement learning,sequential composition control
Supervisor,Robot learning,Online machine learning,Active learning (machine learning),Computer science,Control theory,Control engineering,Dynamical systems theory,Optimization problem,Proactive learning,Reinforcement learning
Conference
ISSN
Citations 
PageRank 
0743-1546
1
0.35
References 
Authors
12
4
Name
Order
Citations
PageRank
Esmaeil Najafi154.35
Gabriel A. D. Lopes218015.66
Subramanya P. Nageshrao3454.95
Robert Babuska42200164.90