Title
Adaptive Interleaved Reinforcement Learning: Robust Stability of Affine Nonlinear Systems With Unknown Uncertainty
Abstract
This article investigates adaptive robust controller design for discrete-time (DT) affine nonlinear systems using an adaptive dynamic programming. A novel adaptive interleaved reinforcement learning algorithm is developed for finding a robust controller of DT affine nonlinear systems subject to matched or unmatched uncertainties. To this end, the robust control problem is converted into the optimal control problem for nominal systems by selecting an appropriate utility function. The performance evaluation and control policy update combined with neural networks approximation are alternately implemented at each time step for solving a simplified Hamilton–Jacobi–Bellman (HJB) equation such that the uniformly ultimately bounded (UUB) stability of DT affine nonlinear systems can be guaranteed, allowing for all realization of unknown bounded uncertainties. The rigorously theoretical proofs of convergence of the proposed interleaved RL algorithm and UUB stability of uncertain systems are provided. Simulation results are given to verify the effectiveness of the proposed method.
Year
DOI
Venue
2022
10.1109/TNNLS.2020.3027653
IEEE Transactions on Neural Networks and Learning Systems
Keywords
DocType
Volume
Interleaved reinforcement learning,neural networks (NNs),robust control,uncertain systems
Journal
33
Issue
ISSN
Citations 
1
2162-237X
2
PageRank 
References 
Authors
0.36
14
5
Name
Order
Citations
PageRank
Jinna Li1999.98
Jinliang Ding228428.96
Tianyou Chai32014175.55
FRANK L. LEWIS45782402.68
Sarangapani Jagannathan5113694.89