Name
Title | ||
|---|---|---|
Finite state approximations of Markov decision processes with general state and action spaces |
Abstract | ||
|---|---|---|
General state space valued optimal stochastic control problems are often computationally intractable. On the other hand, for finite state-action models, there exist powerful computational and simulation tools for computing optimal strategies. With this motivation, we consider finite state and action space approximations of discrete time Markov decision processes with discounted and average costs and compact state and action spaces. Stationary policies obtained from finite state approximations of the original model are shown to approximate the optimal stationary policy with arbitrary precision under mild technical conditions. These results complement recent work that studied the finite action approximation of discrete time Markov decision process with discounted and average costs. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1109/ACC.2015.7171887 | ACC |
Keywords | Field | DocType |
Markov decision processes, stochastic control, finite state approximation, quantization | Kernel (linear algebra),Mathematical optimization,Optimal control,Markov process,Computer science,Markov decision process,Discrete time and continuous time,Markov kernel,State space,Stochastic control | Conference |
ISSN | ISBN | Citations |
0743-1619 | 978-1-4799-8685-9 | 0 |
PageRank | References | Authors |
0.34 | 5 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Naci Saldi | 1 | 29 | 10.27 |
| Tamás Linder | 2 | 617 | 68.20 |
| Serdar Yüksel | 3 | 457 | 53.31 |