Title
Obtaining a Continuous Time Markov Decision Process from Statecharts
Abstract
This paper proposes a strategy to associate Statecharts with a Markov Decision Process for performance evaluation. Statecharts are adapted to represent the possible decision choices and the costs incurred from decisions. Markov Decision Process is used to evaluate the long term effects of decisions. This strategy can aid users without a good knowledge of the performance evaluation process, and may participate in a more effective way in the modeling phase, providing information to make a more realistic model.
Year
DOI
Venue
2009
10.1109/NABIC.2009.5393855
NaBIC
Keywords
Field
DocType
Markov processes,decision making,formal specification,mathematics computing,performance evaluation,Markov decision process,continuous time process,performance evaluation,statecharts
Object-oriented modeling,Markov process,Computer science,Partially observable Markov decision process,Markov decision process,Formal specification,Artificial intelligence,Machine learning,Continuous time markov decision process
Conference
ISSN
Citations 
PageRank 
2164-7364
0
0.34
References 
Authors
4
5