Title
Probability Density Function Estimation Using Orthogonal Forward Regression
Abstract
Using the classical Parzen window estimate as the target function, the kernel density estimation is formulated as a regression problem and the orthogonal forward regression technique is adopted to construct sparse kernel density estimates. The proposed algorithm incrementally minimises a leave-one-out test error score to select a sparse kernel model, and a local regularisation method is incorporated into the density construction process to further enforce sparsity. The kernel weights are finally updated using the multiplicative nonnegative quadratic programming algorithm, which has the ability to reduce the model size further. Except for the kernel width, the proposed algorithm has no other parameters that need tuning, and the user is not required to specify any additional criterion to terminate the density construction procedure. Two examples are used to demonstrate the ability of this regression-based approach to effectively construct a sparse kernel density estimate with comparable accuracy to that of the full-sample optimised Parzen window density estimate.
Year
DOI
Venue
2007
10.1109/IJCNN.2007.4371350
Orlando, FL
Keywords
Field
DocType
estimation theory,quadratic programming,regression analysis,Parzen window estimation,kernel density estimation,leave-one-out test error score,local regularisation method,nonnegative quadratic programming algorithm,orthogonal forward regression technique,probability density function estimation,sparse kernel model
Density estimation,Polynomial kernel,Artificial intelligence,Kernel regression,Kernel density estimation,Mathematical optimization,Multivariate kernel density estimation,Pattern recognition,Kernel embedding of distributions,Algorithm,Variable kernel density estimation,Mathematics,Kernel (statistics)
Conference
ISSN
ISBN
Citations 
1098-7576 E-ISBN : 978-1-4244-1380-5
978-1-4244-1380-5
1
PageRank 
References 
Authors
0.37
6
3
Name
Order
Citations
PageRank
Sheng Chen1129492.85
X. Hong215711.12
Chris J. Harris370066.65