Title
Quasi-random sampling for approximate dynamic programming
Abstract
This paper analyzes quasi-random sampling techniques for approximate dynamic programming. Specifically, low-discrepancy sequences and lattice point sets are investigated and compared as efficient schemes for uniform sampling of the state space in high-dimensional settings. The convergence analysis of the approximate solution is provided basing on geometric properties of the two discretization methods. It is also shown that such schemes are able to take advantage of regularities of the value functions, possibly through suitable transformations of the state vector. Simulation results concerning optimal management of a water reservoirs system and inventory control are presented to show the effectiveness of the considered techniques with respect to pure-random sampling.
Year
DOI
Venue
2013
10.1109/IJCNN.2013.6707065
IJCNN
Keywords
Field
DocType
pure-random sampling,approximate dynamic programming,optimal management,random processes,discretization method,geometric property,convergence analysis,lattice point sets,state space,quasirandom sampling,water reservoir system,high-dimensional setting,sampling methods,dynamic programming,low-discrepancy sequences,inventory control,state vector
Slice sampling,Convergence (routing),Discretization,Dynamic programming,State vector,Mathematical optimization,Computer science,Sampling (statistics),State space,Nonuniform sampling
Conference
ISSN
ISBN
Citations 
2161-4393
978-1-4673-6128-6
4
PageRank 
References 
Authors
0.47
12
4
Name
Order
Citations
PageRank
Cristiano Cervellera122623.63
Mauro Gaggero213017.60
Danilo Macciò36410.95
Roberto Marcialis492.36