Title
From Infinite to Finite Programs: Explicit Error Bounds with Applications to Approximate Dynamic Programming.
Abstract
We consider linear programming (LP) problems in infinite dimensional spaces that are in general computationally intractable. Under suitable assumptions, we develop an approximation bridge from the infinite dimensional LP to tractable finite convex programs in which the performance of the approximation is quantified explicitly. To this end, we adopt the recent developments in two areas of randomized optimization and first-order methods, leading to a priori as well as a posteriori performance guarantees. We illustrate the generality and implications of our theoretical results in the special case of the long-run average cost and discounted cost optimal control problems in the context of Markov decision processes on Borel spaces. The applicability of the theoretical results is demonstrated through a fisheries management problem.
Year
DOI
Venue
2017
10.1137/17M1133087
SIAM JOURNAL ON OPTIMIZATION
Keywords
Field
DocType
infinite dimensional linear programming,Markov decision processes,approximate dynamic programming,randomized and convex optimization
Second-order cone programming,Dynamic programming,Discrete mathematics,Mathematical optimization,Optimal control,A priori and a posteriori,Markov decision process,Average cost,Linear programming,Mathematics,Special case
Journal
Volume
Issue
ISSN
28
3
1052-6234
Citations 
PageRank 
References 
1
0.36
11
Authors
4
Name
Order
Citations
PageRank
Peyman Mohajerin Esfahani120620.74
Tobias Sutter2175.73
Daniel Kuhn355932.80
John Lygeros42742319.22