Title
Singularly perturbed linear programs and Markov decision processes.
Abstract
Linear programming formulations for the discounted and long-run average MDPs have evolved along separate trajectories. In 2006, E. Altman conjectured that the two linear programming formulations of discounted and long-run average MDPs are, most likely, a manifestation of general properties of singularly perturbed linear programs. In this note we demonstrate that this is, indeed, the case.
Year
DOI
Venue
2016
10.1016/j.orl.2016.02.005
Operations Research Letters
Keywords
Field
DocType
Markov Decision Processes (MDPs),Discounted MDPs,Long-run average MDPs,Singularly perturbed linear programs,Limiting linear program
Mathematical optimization,Markov decision process,Linear programming,Mathematics
Journal
Volume
Issue
ISSN
44
3
0167-6377
Citations 
PageRank 
References 
0
0.34
5
Authors
4
Name
Order
Citations
PageRank
Konstantin Avrachenkov11250126.17
Jerzy A. Filar212023.36
Vladimir Gaitsgory37512.86
Andrew Stillman400.34