Name
Title | ||
|---|---|---|
Distributed Adaptive Optimal Regulation of Uncertain Large-Scale Linear Networked Control Systems Using Q-Learning |
Abstract | ||
|---|---|---|
A novel Q-learning approach is presented for the design of a linear adaptive regulator for a large-scale interconnected system. The subsystems communicate with each other through a communication network while another communication network is inserted within the feedback loop of each subsystem. The network induced random delays and data drop out are modeled along with the system dynamics. Stochastic Q-learning is used to adaptively learn the Q-function parameters with periodic and intermittent feedback. For efficient parameter learning with event-sampled feedback, a novel hybrid learning algorithm is proposed. Boundedness of the estimated parameters and asymptotic convergence of state vector in the mean square is achieved and it is demonstrated using Lyapunov stability analysis. Moreover, if the regression function of the QFE is persistently exciting (PE), the estimated parameters converge to their expected target values. The proposed analytical design is validated using a numerical example via simulation. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1109/SSCI.2015.92 | 2015 IEEE Symposium Series on Computational Intelligence |
Keywords | Field | DocType |
Lyapunov stability analysis,regression function,QFE,hybrid learning algorithm,event-sampled feedback,parameter learning,feedback loop,communication network,asymptotic convergence,PE condition,persistency of excitation condition,system state vector,Q-function parameter estimation,data drop out,random delays,linear adaptive regulator design,large-scale interconnected system,stochastic Q-learning approach,uncertain large-scale linear networked control systems,distributed adaptive optimal regulation | Lyapunov function,State vector,Linear-quadratic-Gaussian control,Control theory,Computer science,Networked control system,Q-learning,Adaptive control,Estimation theory,Estimator | Conference |
ISBN | Citations | PageRank |
978-1-4799-7560-0 | 0 | 0.34 |
References | Authors | |
5 | 2 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| vignesh narayanan | 1 | 29 | 3.77 |
| Sarangapani Jagannathan | 2 | 1136 | 94.89 |