Title
Algorithms for maximum-likelihood bandwidth selection in kernel density estimators
Abstract
In machine learning and statistics, kernel density estimators are rarely used on multivariate data due to the difficulty of finding an appropriate kernel bandwidth to overcome overfitting. However, the recent advances on information-theoretic learning have revived the interest on these models. With this motivation, in this paper we revisit the classical statistical problem of data-driven bandwidth selection by cross-validation maximum likelihood for Gaussian kernels. We find a solution to the optimization problem under both the spherical and the general case where a full covariance matrix is considered for the kernel. The fixed-point algorithms proposed in this paper obtain the maximum likelihood bandwidth in few iterations, without performing an exhaustive bandwidth search, which is unfeasible in the multivariate case. The convergence of the methods proposed is proved. A set of classification experiments are performed to prove the usefulness of the obtained models in pattern recognition.
Year
DOI
Venue
2012
10.1016/j.patrec.2012.06.006
Pattern Recognition Letters
Keywords
DocType
Volume
exhaustive bandwidth search,information-theoretic learning,kernel density estimator,appropriate kernel bandwidth,cross-validation maximum likelihood,maximum likelihood bandwidth,classical statistical problem,maximum-likelihood bandwidth selection,gaussian kernel,general case,data-driven bandwidth selection,kernel density estimation,pattern recognition
Journal
33
Issue
ISSN
Citations 
13
0167-8655
8
PageRank 
References 
Authors
0.76
7
2
Name
Order
Citations
PageRank
José M. Leiva-Murillo1313.85
Antonio Artés-Rodríguez220634.76