Title
On the markovian randomized strategy of controller for markov decision processes
Abstract
This paper focuses on the so called controller synthesis problem, which addresses the question of how to limit the internal behavior of a given system implementation to meet its specification, regardless of the behavior enforced by the environment. We consider this problem in the probabilistic setting, where the underlying model has both probabilism and nondeterminism and the nondeterministic choices in some states are assumed to be controllable while the others are under the control of an unpredictable environment. As for the specification, it is defined by probabilistic computation tree logic. We show that under the restriction that the controller exploits only Markovian randomized strategy, the existence of such a controller is decidable, which is done by a reduction to the decidability of first-order theory for reals. This also gives rise to an algorithm which can synthesize the controller if it does exist.
Year
DOI
Venue
2006
10.1007/11881599_17
FSKD
Keywords
Field
DocType
markovian randomized strategy,markov decision process,internal behavior,probabilistic setting,probabilistic computation tree logic,unpredictable environment,system implementation,controller synthesis problem,first-order theory,underlying model,nondeterministic choice,first order
Discrete mathematics,Control theory,Markov process,Nondeterministic algorithm,Computer science,Fuzzy logic,Markov decision process,Probabilistic CTL,Decidability,Artificial intelligence,Probabilistic logic,Machine learning
Conference
Volume
ISSN
ISBN
4223
0302-9743
3-540-45916-2
Citations 
PageRank 
References 
3
0.40
9
Authors
3
Name
Order
Citations
PageRank
Taolue Chen159953.41
Tingting Han2987.34
Jian Lu315517.81