Title
Dynamic Sampling Allocation And Design Selection
Abstract
We formulate the statistical selection problem in a general dynamic framework comprising fully sequential sampling allocation and optimal design selection. Because the traditional probability of correct selection measure is not sufficient to capture both aspects in this more general framework, we introduce the integrated probability of correct selection to better characterize the objective. As a result, the usual selection policy of choosing the design with the largest sample mean as the estimate of the best is no longer necessarily optimal. Rather, the optimal selection policy is to choose the design that maximizes the posterior integrated probability of correct selection, which is a function of the posterior mean and the correlation structure induced by the posterior variance. Because determining the optimal selection policy is generally intractable, we also devise an approximation scheme to efficiently approximate the optimal selection policy. For the allocation policy, we study an asymptotic policy called general Bayesian budget allocation, which is comprised of a sampling statistic and a sequential rule. The optimal computing budget allocation algorithm can be interpreted as a special case of the asymptotical sampling statistics. Numerical examples are provided to illustrate the potential performance improvements, especially in small sample behavior.
Year
DOI
Venue
2016
10.1287/ijoc.2015.0673
INFORMS JOURNAL ON COMPUTING
Keywords
Field
DocType
statistical selection, Bayesian framework, dynamic sampling allocation, optimal design selection
Sequential sampling,Mathematical optimization,Sample mean and sample covariance,Fitness proportionate selection,Optimal design,Correlation,Sampling (statistics),Posterior mean,Statistics,Mathematics
Journal
Volume
Issue
ISSN
28
2
1091-9856
Citations 
PageRank 
References 
7
0.50
14
Authors
4
Name
Order
Citations
PageRank
Yijie Peng13212.59
Chun-Hung Chen21095117.31
Michael C. Fu31161128.16
Jian-Qiang Hu4256.52