Title
Cost-sensitive boosting for classification of imbalanced data
Abstract
Classification of data with imbalanced class distribution has posed a significant drawback of the performance attainable by most standard classifier learning algorithms, which assume a relatively balanced class distribution and equal misclassification costs. The significant difficulty and frequent occurrence of the class imbalance problem indicate the need for extra research efforts. The objective of this paper is to investigate meta-techniques applicable to most classifier learning algorithms, with the aim to advance the classification of imbalanced data. The AdaBoost algorithm is reported as a successful meta-technique for improving classification accuracy. The insight gained from a comprehensive analysis of the AdaBoost algorithm in terms of its advantages and shortcomings in tacking the class imbalance problem leads to the exploration of three cost-sensitive boosting algorithms, which are developed by introducing cost items into the learning framework of AdaBoost. Further analysis shows that one of the proposed algorithms tallies with the stagewise additive modelling in statistics to minimize the cost exponential loss. These boosting algorithms are also studied with respect to their weighting strategies towards different types of samples, and their effectiveness in identifying rare cases through experiments on several real world medical data sets, where the class imbalance problem prevails.
Year
DOI
Venue
2007
10.1016/j.patcog.2007.04.009
Pattern Recognition
Keywords
Field
DocType
application domain,well-developed classification system,class imbalance problem,data mining,adaboost algorithm,accuracy improvement,cost item,imbalanced class distribution,classification accuracy,proposed algorithms tally,cost value,proposed cost-sensitive,cost-sensitive learning,classification,cost exponential loss,effective cost value,adaboost,medical data set,balanced class distribution,imbalanced data,comprehensive analysis
Data mining,Weighting,Data set,Artificial intelligence,Classifier (linguistics),BrownBoost,Tacking,AdaBoost,Pattern recognition,Boosting (machine learning),LPBoost,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
40
12
Pattern Recognition
Citations 
PageRank 
References 
403
9.80
74
Authors
4
Search Limit
100403
Name
Order
Citations
PageRank
Yanmin Sun177021.67
Mohamed S. Kamel24523282.55
Andrew K. C. Wong34063518.39
Yang Wang4948155.42