Abstract | ||
---|---|---|
Constrained blackbox optimization is a difficult problem, with most approaches coming from the mathematical programming literature. The statistical literature is sparse, especially in addressing problems with nontrivial constraints. This situation is unfortunate because statistical methods have many attractive properties: global scope, handling noisy objectives, sensitivity analysis, and so forth. To narrow that gap, we propose a combination of response surface modeling, expected improvement, and the augmented Lagrangian numerical optimization framework. This hybrid approach allows the statistical model to think globally and the augmented Lagrangian to act locally. We focus on problems where the constraints are the primary bottleneck, requiring expensive simulation to evaluate and substantial modeling effort to map out. In that context, our hybridization presents a simple yet effective solution that allows existing objective-oriented statistical approaches, like those based on Gaussian process surrogates and expected improvement heuristics, to be applied to the constrained setting with minor modification. This work is motivated by a challenging, real-data benchmark problem from hydrology where, even with a simple linear objective function, learning a nontrivial valid region complicates the search for a global minimum. Supplementary materials for this article are available online. |
Year | DOI | Venue |
---|---|---|
2016 | 10.1080/00401706.2015.1014065 | TECHNOMETRICS |
Keywords | Field | DocType |
Surrogate model,Additive penalty method,Nonparametric regression and sequential design,Gaussian process,Emulator,Expected improvement | Econometrics,Bottleneck,Mathematical optimization,Surrogate model,Augmented Lagrangian method,Gaussian process,Statistical model,Response surface modeling,Statistics,Mathematics,Constrained optimization | Journal |
Volume | Issue | ISSN |
58.0 | 1.0 | 0040-1706 |
Citations | PageRank | References |
18 | 0.95 | 15 |
Authors | ||
7 |
Name | Order | Citations | PageRank |
---|---|---|---|
Robert Gramacy | 1 | 240 | 30.15 |
Genetha Anne Gray | 2 | 87 | 7.57 |
Digabel Sébastien Le | 3 | 20 | 2.01 |
Herbert K. H. Lee | 4 | 209 | 34.39 |
Pritam Ranjan | 5 | 66 | 7.73 |
Garth N. Wells | 6 | 202 | 20.08 |
Stefan M. Wild | 7 | 481 | 31.93 |