Title
Investigation on Diversity in Homogeneous and Heterogeneous Ensembles
Abstract
The performance of an ensemble can be affected by several factors and diversity amongst its member models is considered as a key factor. However, creating a high-level of diversity is not a simple task as the models that are trained using a single learning algorithm for a given problem, hence named homogeneous models, tend to be closely correlated. Different learning algorithms are then used to generate methodologically different type of models - heterogeneous models, in the hope of increasing diversity and therefore improving ensemble accuracy. Ensemble applications that are implemented without considering diversity between their member models are likely to result in little or no performance gain. This study evaluates the ability of diversity generation of different learning algorithms through quantitatively examining the diversity between homogeneous models and heterogeneous models. Further, the characteristics of ten diversity definitions are evaluated and analysed with an intention of finding out which one is more effective in terms of improving ensemble performance. Fifteen data sets are used in this study to verify the consistence of the experimental findings.
Year
DOI
Venue
2006
10.1109/IJCNN.2006.247268
IJCNN
Keywords
Field
DocType
context modeling,machine learning,sampling methods
Data set,Homogeneous,Computer science,Context model,Sampling (statistics),Artificial intelligence,Generalization error,Ensemble learning,Machine learning
Conference
ISSN
ISBN
Citations 
2161-4393
0-7803-9490-9
0
PageRank 
References 
Authors
0.34
24
2
Name
Order
Citations
PageRank
Shun Bian1271.67
Wenjia Wang2579.12