Title
Niching an estimation-of-distribution algorithm by hierarchical Gaussian mixture learning.
Abstract
Estimation-of-Distribution Algorithms (EDAs) have been applied with quite some success when solving real-valued optimization problems, especially in the case of Black Box Optimization (BBO). Generally the performance of an EDA depends on the match between its driving probability distribution and the landscape of the problem being solved. Because most well-known EDAs, including CMA-ES, NES, and AMaLGaM, use a uni-modal search distribution, they have a high risk of getting trapped in local optima when a problem is multi-modal with a (moderate) number of relatively comparable modes. This risk could potentially be mitigated using niching methods that define multiple regions of interest where separate search distributions govern sub-populations. However, a key question is how to determine a suitable number of niches, especially in BBO. In this paper, we present a novel, adaptive niching approach that determines the niches through hierarchical clustering based on the correlation between the probability densities and fitness values of solutions. We test the performance of a combination of this niching approach with AMaLGaM on both new and well-known niching benchmark problems and find that the new approach properly identifies multiple landscape modes, leading to much better performance on multi-modal problems than with a non-niched, uni-modal EDA.
Year
DOI
Venue
2017
10.1145/3071178.3071283
GECCO
Keywords
Field
DocType
continuous optimization, black box, estimation of distribution algorithm, Gaussian mixture model, hierarchical clustering
Hierarchical clustering,Continuous optimization,EDAS,Mathematical optimization,Estimation of distribution algorithm,Local optimum,Computer science,Probability distribution,Artificial intelligence,Optimization problem,Mixture model,Machine learning
Conference
Citations 
PageRank 
References 
3
0.42
11
Authors
4
Name
Order
Citations
PageRank
S. C. Maree181.86
Tanja Alderliesten211321.16
Dirk Thierens31120117.00
Peter A. N. Bosman450749.04