Title
Benchmarking And Evaluating Matlab Derivative-Free Optimisers For Single-Objective Applications
Abstract
MATLAB (R) builds in a number of derivative-free optimisers (DFOs), conveniently providing tools beyond conventional optimisation means. However, with the increase of available DFOs and being compounded by the fact that DFOs are often problem dependent and parameter sensitive, it has become challenging to determine which one would be most suited to the application at hand, but there exist no comparisons on MATLAB DFOs so far. In order to help engineers use MATLAB for their applications without needing to learn DFOs in detail, this paper evaluates the performance of all seven DFOs in MATLAB and sets out an amalgamated benchmark of multiple benchmarks. The DFOs include four heuristic algorithms -simulated annealing, particle swarm optimization (PSO), the genetic algorithm (GA), and the genetic algorithm with elitism (GAe), and three direct-search algorithms -Nelder-Mead's simplex search, pattern search (PS) and Powell's conjugate search. The five benchmarks presented in this paper exceed those that have been reported in the literature. Four benchmark problems widely adopted in assessing evolutionary algorithms are employed. Under MATLAB's default settings, it is found that the numerical optimisers Powell is the aggregative best on the unimodal Quadratic Problem, PSO on the lower dimensional Scaffer Problem, PS on the lower dimensional Composition Problem, while the extra-numerical genotype GAe is the best on the Varying Landscape Problem and on the other two higher dimensional problems. Overall, the GAe offers the highest performance, followed by PSO and Powell. The amalgamated benchmark quantifies the advantage and robustness of heuristic and population-based optimisers (GAe and PSO), especially on multimodal problems.
Year
DOI
Venue
2017
10.1007/978-3-319-63312-1_7
INTELLIGENT COMPUTING THEORIES AND APPLICATION, ICIC 2017, PT II
Keywords
Field
DocType
Evolutionary algorithms, Heuristic search, Direct search methods, Derivative-free optimisation, Benchmarking
Simulated annealing,Particle swarm optimization,Population,Heuristic,Mathematical optimization,Evolutionary algorithm,Computer science,Robustness (computer science),Artificial intelligence,Genetic algorithm,Pattern search,Machine learning
Conference
Volume
ISSN
Citations 
10362
0302-9743
1
PageRank 
References 
Authors
0.38
2
6
Name
Order
Citations
PageRank
Lin Li132379.92
Yi Chen2386.80
Qunfeng Liu3506.76
Jasmina Lazic410.38
Wuqiao Luo531.23
Yun Li6342.23