Title
PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting.
Abstract
In this paper, we consider a high-dimensional nonparametric regression model with fixed design and iid random errors. We propose an estimator by exponential weighted aggregation with a group-analysis sparsity and a prior on the weights. We prove that our estimator satisfies a sharp group-analysis sparse oracle inequality with a small remainder term that ensures its good theoretical performance. We also propose a forward–backward proximal Langevin Monte Carlo algorithm to sample from the target distribution (which is neither smooth nor log-concave) and derive its convergence guarantees. In turn, this enables us to implement our estimator and validate it with numerical experiments.
Year
DOI
Venue
2019
10.1016/j.jmva.2018.12.004
Journal of Multivariate Analysis
Keywords
Field
DocType
62G07,62G20
Econometrics,Weighting,Exponential function,Regression analysis,Remainder,Group analysis,Sparse regression,Statistics,Mathematics,Bayesian probability,Estimator
Journal
Volume
ISSN
Citations 
171
0047-259X
0
PageRank 
References 
Authors
0.34
10
3
Name
Order
Citations
PageRank
Duy Tung Luu100.34
Jalal Fadili2118480.08
Christophe Chesneau373.85