Name
Title | ||
|---|---|---|
Multivariate regression model selection from small samples using Kullback's symmetric divergence |
Abstract | ||
|---|---|---|
The Kullback Information Criterion, KIC, and its univariate bias-corrected version, KICc, are two new developed criteria for model selection. The two criteria can be viewed as estimators of the expected Kullback symmetric divergence and they have a fixed bias corrected term. In this paper, a new small sample model selection criterion for multivariate regression models is developed. The proposed criterion is named KICvc, where the notation "vc" stands for vector correction, and it can be considered as an extension of KIC for multivariate regression models. KICvc adjusts KIC to be an unbiased estimator for the variant of the Kullback symmetric divergence, assuming that the true model is correctly specified or overfitted. Furthermore, KICvc provides better multivariate regression model order or dimension choices than KIC in small samples. Simulation results shows that the proposed criterion estimates the model order more accurately than other asymptotically efficient methods when applied to multivariate regression model selection in small samples. As a result, KICvc serves as an effective tool for selecting a multivariate regression model of appropriate dimension. A theoretical justification of the proposed criterion is presented. |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1016/j.sigpro.2005.10.009 | Signal Processing |
Keywords | Field | DocType |
symmetric divergence,small sample,new developed criterion,regression model selection,model order,multivariate regression model selection,multivariate regression model,new small sample model,multivariate regression model order,model selection,proposed criterion,true model,unbiased estimator,vectors,estimation,mathematical models,aic,multivariate regression | Divergence,Multivariate statistics,Regression analysis,Model selection,Bias of an estimator,Mathematical model,Statistics,Univariate,Mathematics,Estimator | Journal |
Volume | Issue | ISSN |
86 | 8 | Signal Processing |
Citations | PageRank | References |
6 | 0.90 | 3 |
Authors | ||
1 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Abd-Krim Seghouane | 1 | 193 | 24.99 |