Paper Info
Title
On equivalence of algorithm's implementations - the CMA-ES algorithm and its five implementations.
Abstract
When a new optimization algorithm is proposed, it is compared with state-of-the-art methods. That comparison is made using implementations of the algorithms, but names and versions of the implementations are usually not revealed. This paper compares five implementations of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) taken from a trusted source. The comparisons were performed using the Comparing Continuous Optimizers (COCO) platform. The results show that all examined implementations produce a different outcome. The variation of the results stems from differences in the auxiliary codes of the implementations and from implementing an algorithm which is still under development. It is therefore important to use an appropriate implementation for experiments. Using a weak implementation can lead to the wrong conclusions.
Year
DOI
Venue
2019
10.1145/3319619.3322011
GECCO
Keywords
Field
DocType
experiments replication, benchmarking, algorithm-implementation gap, CMA-ES
Mathematical optimization,Computer science,Theoretical computer science,Implementation,Equivalence (measure theory),CMA-ES
Conference
ISBN
Citations 
PageRank 
978-1-4503-6748-6
0
0.34
References 
Authors
0
1
Name
Order
Citations
PageRank
Rafal Biedrzycki172.82