Title
Neural network and regression spline value function approximations for stochastic dynamic programming
Abstract
Dynamic programming is a multi-stage optimization method that is applicable to many problems in engineering. A statistical perspective of value function approximation in high-dimensional, continuous-state stochastic dynamic programming (SDP) was first presented using orthogonal array (OA) experimental designs and multivariate adaptive regression splines (MARS). Given the popularity of artificial neural networks (ANNs) for high-dimensional modeling in engineering, this paper presents an implementation of ANNs as an alternative to MARS. Comparisons consider the differences in methodological objectives, computational complexity, model accuracy, and numerical SDP solutions. Two applications are presented: a nine-dimensional inventory forecasting problem and an eight-dimensional water reservoir problem. Both OAs and OA-based Latin hypercube experimental designs are explored, and OA space-filling quality is considered.
Year
DOI
Venue
2007
10.1016/j.cor.2005.02.043
Computers & Operations Research
Keywords
DocType
Volume
Design of experiments,Statistical modeling,Markov decision process,Orthogonal array,Latin hypercube,Inventory forecasting,Water reservoir management
Journal
34
Issue
ISSN
Citations 
1
0305-0548
21
PageRank 
References 
Authors
1.31
9
3
Name
Order
Citations
PageRank
Cristiano Cervellera122623.63
Aihong Wen2473.13
Victoria C.P. Chen3253.10