Title
The degrees of freedom of the Group Lasso for a General Design
Abstract
In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, and where only a few of them are assumed to be active. In such a situation, the group Lasso is an at- tractive method for variable selection since it promotes sparsity of the groups. We study the sensitivity of any group Lasso solution to the observations and provide its precise local parameterization. When the noise is Gaussian, this allows us to derive an unbiased estimator of the degrees of freedom of the group Lasso. This result holds true for any fixed design, no matter whether it is under- or overdetermined. With these results at hand, various model selec- tion criteria, such as the Stein Unbiased Risk Estimator (SURE), are readily available which can provide an objectively guided choice of the optimal group Lasso fit.
Year
Venue
Keywords
2012
CoRR
degrees of freedom,sparsity
Field
DocType
Volume
Overdetermined system,Covariate,Mathematical optimization,Feature selection,Parametrization,Group lasso,Bias of an estimator,Gaussian,Mathematics,Estimator
Journal
abs/1212.6478
Citations 
PageRank 
References 
3
0.43
1
Authors
5
Name
Order
Citations
PageRank
Samuel Vaiter1508.39
Charles-Alban Deledalle238724.00
Gabriel Peyré3119579.60
Jalal Fadili4118480.08
Charles Dossal5968.41