Title
Learning Robust LQ-Controllers Using Application Oriented Exploration
Abstract
This letter concerns the problem of learning robust LQ-controllers, when the dynamics of the linear system are unknown. First, we propose a robust control synthesis method to minimize the worst-case LQ cost, with probability <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$1-\delta $ </tex-math></inline-formula> , given empirical observations of the system. Next, we propose an approximate dual controller that simultaneously regulates the system and reduces model uncertainty. The objective of the dual controller is to minimize the worst-case cost attained by a new robust controller, synthesized with the reduced model uncertainty. The dual controller is subject to an exploration budget in the sense that it has constraints on its worst-case cost with respect to the current model uncertainty. In our numerical experiments, we observe better performance of the proposed robust LQ regulator over the existing methods. Moreover, the dual control strategy gives promising results in comparison with the common greedy random exploration strategies.
Year
DOI
Venue
2020
10.1109/LCSYS.2019.2921512
IEEE Control Systems Letters
Keywords
Field
DocType
Uncertainty,Data models,Robustness,Robust control,Control systems,Adaptation models,Estimation error
Regulator,Data modeling,Control theory,Linear system,Control theory,Computer science,Robustness (computer science),Control system,Robust control
Journal
Volume
Issue
ISSN
4
1
2475-1456
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Mina Ferizbegovic101.69
Jack Umenberger294.90
Håkan Hjalmarsson31254175.16
Thomas B. Schön474472.66