Name
Abstract | ||
|---|---|---|
Parameters in logistic regression models are commonly estimated by the method of maximum likelihood, while the model structure is selected with stepwise regression and a model selection criterion, such as AIC or BIC. There are two important disadvantages of this approach: (1) maximum likelihood estimates are biased and infinite when the data is linearly separable, and (2) the AIC and BIC model selection criteria are asymptotic in nature and tend to perform well only when the sample size is moderate to large. This paper introduces a novel criterion, based on the Minimum Message Length (MML) principle, for parameter estimation and model selection of logistic regression models. The new criterion is shown to outperform maximum likelihood in terms of parameter estimation, and outperform both AIC and BIC in terms of model selection using both real and artificial data. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1007/978-3-642-35101-3_74 | Australasian Conference on Artificial Intelligence |
Keywords | Field | DocType |
model structure,parameter estimation,maximum likelihood,novel criterion,new criterion,maximum likelihood estimate,rotation invariant prior,bic model selection criterion,model selection criterion,model selection,mml logistic regression,logistic regression model | Deviance information criterion,Bayesian information criterion,Stepwise regression,Model selection,Fisher information,Estimation theory,Prior probability,Statistics,Logistic regression,Mathematics | Conference |
Citations | PageRank | References |
2 | 0.45 | 2 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Enes Makalic | 1 | 55 | 11.54 |
| Daniel F. Schmidt | 2 | 51 | 10.68 |