Title
Hybrid ensemble learning approach for generation of classification rules
Abstract
Due to the daily increase in the size of data, machine learning has become a popular approach for intelligent processing of data. In particular, machine learning algorithms are used to discover meaningful knowledge or build predictive models from data. For example, inductive learning algorithms involve generation of rules which can be in the form of either a decision tree or if-then rules. However, most of learning algorithms suffer from overfitting of training data. In other words, these learning algorithms can build models that perform extremely well on training data but poorly on other data. The overfitting problem is originating from both learning algorithms and data. In this context, the nature of machine learning problem can be referred to as bias and variance. The former is originating from learning algorithms whereas the latter is originating from data. Therefore, the reduction of overfitting can be achieved through scaling up algorithms on one side or scaling down data on the other side. Both bias and variance can be reduced through use of ensemble learning approaches. This paper introduces particular ways to address the issues on overfitting of rule based classifiers through both scaling up algorithms and scaling down data in the context of ensemble learning.
Year
DOI
Venue
2015
10.1109/ICMLC.2015.7340951
2015 International Conference on Machine Learning and Cybernetics (ICMLC)
Keywords
Field
DocType
Data mining,Machine learning,Ensemble learning,Inductive learning,If-then rules,Rule based classification
Online machine learning,Semi-supervised learning,Instance-based learning,Pattern recognition,Computer science,Supervised learning,Artificial intelligence,Structural risk minimization,Overfitting,Ensemble learning,Machine learning,Learning classifier system
Conference
Volume
ISSN
Citations 
1
2160-133X
1
PageRank 
References 
Authors
0.35
5
3
Name
Order
Citations
PageRank
Han Liu13811.99
Alexander E. Gegov2478.47
Mihaela Cocea321533.18