Name
Abstract | ||
|---|---|---|
We marry continuous time Markov decision processes (CTMDPs) with stochastic timed automata into a model with joint expressive power. This extension is very natural, as the two original models already share exponentially distributed sojourn times in locations. It enriches CTMDPs with timing constraints, or symmetrically, stochastic timed automata with one conscious player. Our model maintains the existence of optimal control known for CTMDPs. This also holds for a richer model with two players, which extends continuous time Markov games. But we have to sacrifice the existence of simple schedulers: polyhedral regions are insufficient to obtain optimal control even in the single-player case. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1007/978-3-642-33365-1_5 | FORMATS |
Keywords | Field | DocType |
polyhedral region,joint expressive power,sojourn time,richer model,original model,random delay,conscious player,optimal control,share exponentially,continuous time markov decision,continuous time markov game | Random delay,Optimal control,Computer science,Automaton,Markov chain,Markov decision process,Theoretical computer science,Exponential distribution,Expressive power | Conference |
Citations | PageRank | References |
3 | 0.41 | 17 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Nathalie Bertrand | 1 | 250 | 17.84 |
| Sven Schewe | 2 | 496 | 42.54 |