Title
Estimation with Norm Regularization.
Abstract
Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This paper presents generalizations of such estimation error analysis on all four aspects. We characterize the restricted error set, establish relations between error sets for the constrained and regularized problems, and present an estimation error bound applicable to any norm. Precise characterizations of the bound is presented for a variety of noise models, design matrices, including sub-Gaussian, anisotropic, and dependent samples, and loss functions, including least squares and generalized linear models. Gaussian width, a geometric measure of size of sets, and associated tools play a key role in our generalized analysis.
Year
Venue
Field
2014
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014)
Least squares,Condition number,Mathematical optimization,Matrix (mathematics),Lasso (statistics),Design matrix,Gaussian,Regularization (mathematics),Generalized linear model,Mathematics
DocType
Volume
ISSN
Conference
27
1049-5258
Citations 
PageRank 
References 
20
1.12
15
Authors
4
Name
Order
Citations
PageRank
Arindam Banerjee1313.77
Sheng Chen2514.22
Farideh Fazayeli3966.81
Vidyashankar Sivakumar4333.52