Title
A model selection approach to signal denoising using Kullback's symmetric divergence
Abstract
We consider the determination of a soft/hard coefficients threshold for signal recovery embedded in additive Gaussian noise. This is closely related to the problem of variable selection in linear regression. Viewing the denoising problem as a model selection one, we propose a new information theoretical model selection approach to signal denoising. We first construct a statistical model for the unknown signal and then try to find the best approximating model (corresponding to the denoised signal) from a set of candidates. We adopt the Kullback's symmetric divergence as a measure of similarity between the unknown model and the candidate model. The best approximating model is the one that minimizes an unbiased estimator of this divergence. The advantage of a denoising method based on model selection over classical thresholding approaches, resides in the fact that the threshold is determined automatically without the need to estimate the noise variance. The proposed denoising method, called KICc-denoising (Kullback Information Criterion corrected) is compared with cross validation (CV), minimum description length (MDL) and the classical methods SureShrink and VisuShrink via a simulation study based on three different type of signals: chirp, seismic and piecewise polynomial.
Year
DOI
Venue
2006
10.1016/j.sigpro.2005.03.023
Signal Processing
Keywords
DocType
Volume
denoised signal,unknown model,denoising method,proposed denoising method,information criterion,denoising problem,theoretical model selection approach,signal denoising,approximating model,model selection,symmetric divergence,statistical model,candidate model,cross validation,unbiased estimator,linear regression,variable selection,gaussian noise,minimum description length
Journal
86
Issue
ISSN
Citations 
7
Signal Processing
3
PageRank 
References 
Authors
0.53
5
4
Name
Order
Citations
PageRank
maiza bekara1375.04
Luc Knockaert2358.89
Abd-Krim Seghouane319324.99
G. A. Fleury415127.74