Title
Semi-Analytic Resampling in Lasso
Abstract
An approximate method for conducting resampling in Lasso, the $ell_1$ penalized linear regression, in a semi-analytic manner is developed, whereby the average over the resampled datasets is directly computed without repeated numerical sampling, thus enabling an inference free of the statistical fluctuations due to sampling finiteness, as well as a significant reduction of computational time. The proposed method is employed to implement bootstrapped Lasso (Bolasso) and stability selection, both of which are variable selection methods using resampling in conjunction with Lasso, and it resolves their disadvantage regarding computational cost. To examine approximation accuracy and efficiency, numerical experiments were carried out using simulated datasets. Moreover, an application to a real-world dataset, the wine quality dataset, is presented. To process such real-world datasets, an objective criterion for determining the relevance of selected variables is also introduced by the addition of noise variables and resampling.
Year
Venue
Field
2019
Journal of Machine Learning Research
Pattern recognition,Lasso (statistics),Artificial intelligence,Resampling,Machine learning,Mathematics
DocType
Volume
Issue
Journal
20
70
Citations 
PageRank 
References 
0
0.34
12
Authors
2
Name
Order
Citations
PageRank
Tomoyuki Obuchi1115.65
Yoshiyuki Kabashima213627.83