Title
A criterion for model selection in the presence of incomplete data based on Kullback's symmetric divergence
Abstract
A criterion is proposed for model selection in the presence of incomplete data. It's construction is based on the motivations provided for the KIC criterion that has been recently developed and for the PDIO (predictive divergence for incomplete observation models) criterion. The proposed criterion serves as an asymptotically unbiased estimator of the complete data Kullback-Leibler symmetric divergence between a candidate model and the generating model. It is therefore a natural extension of KIC to settings where the observed data is incomplete and is equivalent to KIC when there is no missing data. The proposed criterion differs from PDIO in its goodness of fit term and its complexity term, but it differs from AICcd (where the notation "cd" stands for "complete data") only in its complexity term. Unlike AIC, KIC and PDIO this criterion can be evaluated using only complete data tools, readily available through the EM and SEM algorithms. The performance of the proposed criterion relative to other well-known criteria are examined in a simulation study.
Year
DOI
Venue
2005
10.1016/j.sigpro.2005.02.004
Signal Processing
Keywords
Field
DocType
symmetric divergence,well-known criterion,observed data,kic criterion,complete data,incomplete data,complete data tool,complexity term,candidate model,missing data,model selection,proposed criterion,unbiased estimator,goodness of fit,em algorithm,kullback leibler
Information theory,Applied mathematics,Mathematical optimization,Bayesian information criterion,Divergence,Expectation–maximization algorithm,Model selection,Bias of an estimator,Missing data,Statistics,Goodness of fit,Mathematics
Journal
Volume
Issue
ISSN
85
7
Signal Processing
Citations 
PageRank 
References 
8
1.05
7
Authors
3
Name
Order
Citations
PageRank
Abd-Krim Seghouane119324.99
maiza bekara2375.04
G. A. Fleury315127.74