Title
On the Combination of Logistic Regression and Local Probability Estimates
Abstract
Classifiers based on parametric or non-parametric learning methods have different advantages and disadvantages. To take advantage of the strengths of both methods, we propose an algorithm that combines a parametric model (logistic regression) with a non-parametric classification method (k-nearest neighbors). This combination is based on a measure of appropriateness that uses a heuristic to decide which of the two components should contribute more to the final classification output. We measure the performance of this combination method on two data sets (one from medical informatics, and one consisting of simulated data) in terms of areas under the ROC curves (AUCs). We are able to demonstrate that our method of combining classifiers exceeds the performance of both individual classifiers taken separately.
Year
DOI
Venue
2008
10.1109/BROADCOM.2008.59
African J. of Inf. & Commun. Technology
Keywords
DocType
Volume
parametric model,logistic regression,local probability estimates,roc curve,simulated data,individual classifier,combination method,k-nearest neighbor,different advantage,final classification output,non-parametric classification method,machine learning
Conference
5
Issue
Citations 
PageRank 
2
1
0.36
References 
Authors
12
4
Name
Order
Citations
PageRank
Melanie Osl1716.83
Christian Baumgartner2232.98
Bernhard Tilg39216.57
Stephan Dreiseitl433834.80