Name
Title | ||
|---|---|---|
Robust control of uncertain Markov Decision Processes with temporal logic specifications |
Abstract | ||
|---|---|---|
We present a method for designing a robust control policy for an uncertain system subject to temporal logic specifications. The system is modeled as a finite Markov Decision Process (MDP) whose transition probabilities are not exactly known but are known to belong to a given uncertainty set. A robust control policy is generated for the MDP that maximizes the worst-case probability of satisfying the specification over all transition probabilities in this uncertainty set. To this end, we use a procedure from probabilistic model checking to combine the system model with an automaton representing the specification. This new MDP is then transformed into an equivalent form that satisfies assumptions for stochastic shortest path dynamic programming. A robust version of dynamic programming solves for a ε-suboptimal robust control policy with time complexity O(log1/ε) times that for the non-robust case. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1109/CDC.2012.6426174 | Decision and Control |
Keywords | Field | DocType |
Markov processes,computational complexity,control system synthesis,dynamic programming,formal verification,robust control,temporal logic,uncertain systems,ε-suboptimal robust control policy,MDP,O(log1/ε) times,automaton,equivalent form,finite Markov decision process,probabilistic model checking,robust control policy design,stochastic shortest path dynamic programming,temporal logic specifications,time complexity,transition probabilities,uncertain Markov decision processes,uncertain system,worst-case probability | Dynamic programming,Mathematical optimization,Markov process,Computer science,Partially observable Markov decision process,Markov decision process,Temporal logic,Robust control,Time complexity,Formal verification | Conference |
ISSN | ISBN | Citations |
0743-1546 E-ISBN : 978-1-4673-2064-1 | 978-1-4673-2064-1 | 31 |
PageRank | References | Authors |
1.08 | 12 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Eric M. Wolff | 1 | 31 | 1.08 |
| U. Topcu | 2 | 157 | 7.13 |
| Richard M. Murray | 3 | 12322 | 1223.70 |