Title
Optimal Learning In Linear Regression With Combinatorial Feature Selection
Abstract
We present a new framework for sequential information collection in applications where regression is used to learn about a set of unknown parameters and alternates with optimization to design new data points. Such problems can be handled using the framework of ranking and selection (R&S), but traditional R&S procedures will experience high computational costs when the decision space grows combinatorially. This challenge arises in many applications of business analytics; in particular, we are motivated by the problem of efficiently learning effective strategies for nonprofit fundraising. We present a value of information procedure for simultaneously learning unknown regression parameters and unknown sampling noise. We then develop approximate versions of the procedure, based on optimal quantization, that retain good performance and scale better to large problems.
Year
DOI
Venue
2016
10.1287/ijoc.2016.0709
INFORMS JOURNAL ON COMPUTING
Keywords
Field
DocType
optimal learning, ranking and selection, simulation optimization, Bayesian linear regression
Data point,Mathematical optimization,Feature selection,Ranking,Bayesian linear regression,Value of information,Sampling (statistics),Artificial intelligence,Quantization (signal processing),Mathematics,Machine learning,Linear regression
Journal
Volume
Issue
ISSN
28
4
1091-9856
Citations 
PageRank 
References 
2
0.37
17
Authors
3
Name
Order
Citations
PageRank
Bin Han140.73
Ilya O. Ryzhov212814.12
Boris Defourny3256.26