Abstract | ||
---|---|---|
In this paper, we propose an optimal online control method for discrete-time nonlinear Markov jump systems (MJSs). The Markov chain and the weighted sum technique are introduced to convert the Markov jumping problem into an optimal control problem. We then use adaptive dynamic programming (ADP) to accomplish online learning and control with specific learning algorithm and detailed stability analysis, including the convergence of the performance index function sequence and the existence of the corresponding admissible control input. Neural networks are applied to implement this ADP approach and online learning method is used to tune the weights of the critic and the action networks. Two different numerical examples are given to demonstrate the effectiveness of the proposed method. |
Year | DOI | Venue |
---|---|---|
2015 | 10.1016/j.neucom.2014.01.060 | Neurocomputing |
Keywords | Field | DocType |
Adaptive dynamic programming,Neural network,Markov jump systems,Optimal control | Dynamic programming,Optimal control,Markov model,Computer science,Markov chain,Markov decision process,Artificial intelligence,Variable-order Markov model,Artificial neural network,Machine learning,Markov algorithm | Journal |
Volume | Issue | ISSN |
149 | PA | 0925-2312 |
Citations | PageRank | References |
17 | 0.56 | 28 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Xiangnan Zhong | 1 | 346 | 16.35 |
Haibo He | 2 | 3653 | 213.96 |
H Zhang | 3 | 7027 | 358.18 |
Zhanshan Wang | 4 | 2194 | 106.95 |