Name
Abstract | ||
|---|---|---|
study finite-state controllers (FSCs) for partially observable Markov decision processes (POMDPs). The key insight is that computing (randomized) FSCs on POMDPs is equivalent to synthesis for parametric Markov chains (pMCs). This correspondence enables using parameter synthesis techniques to compute FSCs for POMDPs in a black-box fashion. We investigate how typical restrictions on parameter values affect the quality of the obtained FSCs. Permissive strategies for POMDPs are obtained as regions of parameter values, a natural output of parameter synthesis techniques. Experimental evaluation on several POMDP benchmarks shows promising results. |
Year | Venue | Field |
|---|---|---|
2017 | arXiv: Logic in Computer Science | Observable,Partially observable Markov decision process,Markov chain,Algorithm,Markov decision process,Parametric statistics,Finite state controllers,Mathematics |
DocType | Volume | Citations |
Journal | abs/1710.10294 | 2 |
PageRank | References | Authors |
0.37 | 20 | 7 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Sebastian Junges | 1 | 184 | 20.78 |
| Nils Jansen | 2 | 284 | 27.77 |
| Ralf Wimmer | 3 | 407 | 34.28 |
| Tim Quatmann | 4 | 6 | 3.11 |
| Leonore Winterer | 5 | 9 | 2.14 |
| Joost-Pieter Katoen | 6 | 19 | 4.54 |
| B. Becker | 7 | 191 | 21.44 |