Title
A novel Bagged Naïve Bayes-Decision Tree approach for multi-class classification problems.
Abstract
Breakthrough classification performances have been achieved by utilizing ensemble techniques in machine learning and data mining. Bagging is one such ensemble technique that has outperformed single models in obtaining higher predictive performances. This paper proposes an ensemble technique by utilizing the basic bootstrap aggregating technique on hybridization of two base learners namely Naive Bayes (NB) and Decision Tree (DT). Before induction of the DT, NB algorithm is employed for eliminating mislabeled or contradictory instances from the training set. Consequently, bagging approach is applied on hybrid NBDT as the base learner. The resultant Bagged Naive Bayes-Decision Tree (BNBDT) algorithm is then used for improving the classification accuracy of various multi-class problems. This algorithm iteratively trains the base learner from random samples of the training set, and then performs majority voting of their predictions. The proposed algorithm is compared with both ensemble and single classification techniques such as Random Forest, Bagged NB, Bagged DT, NB, and DT. Experimental results over 52 UCI data sets with bag size 100 demonstrate that the proposed algorithm significantly outperforms the existing algorithms.
Year
DOI
Venue
2019
10.3233/JIFS-169937
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS
Keywords
DocType
Volume
Bagging,naive bayes,decision tree,classification,multi-class problems,machine learning,hybrid learner
Journal
36
Issue
ISSN
Citations 
3
1064-1246
0
PageRank 
References 
Authors
0.34
0
2
Name
Order
Citations
PageRank
Namrata Singh120.70
Pradeep Singh2175.62