Title
A neural network based online learning and control approach for Markov jump systems.
Abstract
In this paper, we propose an optimal online control method for discrete-time nonlinear Markov jump systems (MJSs). The Markov chain and the weighted sum technique are introduced to convert the Markov jumping problem into an optimal control problem. We then use adaptive dynamic programming (ADP) to accomplish online learning and control with specific learning algorithm and detailed stability analysis, including the convergence of the performance index function sequence and the existence of the corresponding admissible control input. Neural networks are applied to implement this ADP approach and online learning method is used to tune the weights of the critic and the action networks. Two different numerical examples are given to demonstrate the effectiveness of the proposed method.
Year
DOI
Venue
2015
10.1016/j.neucom.2014.01.060
Neurocomputing
Keywords
Field
DocType
Adaptive dynamic programming,Neural network,Markov jump systems,Optimal control
Dynamic programming,Optimal control,Markov model,Computer science,Markov chain,Markov decision process,Artificial intelligence,Variable-order Markov model,Artificial neural network,Machine learning,Markov algorithm
Journal
Volume
Issue
ISSN
149
PA
0925-2312
Citations 
PageRank 
References 
17
0.56
28
Authors
4
Name
Order
Citations
PageRank
Xiangnan Zhong134616.35
Haibo He23653213.96
H Zhang37027358.18
Zhanshan Wang42194106.95