Paper Info
Title
The impact of Quality Indicators on the rating of Multi-objective Evolutionary Algorithms.
Abstract
The figure displays confidence interval of Quality Indicators GD to R2 which both assess convergence to the Pareto optimal front. We can see that they are in contradiction with each other and that they ranked MOEAs exactly the opposite. CRS4EAs has discovered significant differences between MOEAs, showing us the impact of different QIs on the ranking even when they assess the same aspects of quality.Display Omitted A detailed analysis of Quality Indicators using a novel method called Chess Rating System for Evolutionary Algorithms (CRS4EAs).Experiments conducted on synthetic and real-world problems.Acquired new knowledge about Quality Indicators. Evaluating and comparing multi-objective optimizers is an important issue. But, when doing a comparison, it has to be noted that the results can be influenced highly by the selected Quality Indicator. Therefore, the impact of individual Quality Indicators on the ranking of Multi-objective Optimizers in the proposed method must be analyzed beforehand. In this paper the comparison of several different Quality Indicators with a method called Chess Rating System for Evolutionary Algorithms (CRS4EAs) was conducted in order to get a better insight on their characteristics and how they affect the ranking of Multi-objective Evolutionary Algorithms (MOEAs). Although it is expected that Quality Indicators with the same optimization goals would yield a similar ranking of MOEAs, it has been shown that results can be contradictory and significantly different. Consequently, revealing that claims about the superiority of one MOEA over another can be misleading.
Year
DOI
Venue
2017
10.1016/j.asoc.2017.01.038
Appl. Soft Comput.
Keywords
Field
DocType
Multi-objective optimization,Evolutionary Algorithms,Quality Indicator,Performance assessment,Chess rating
Convergence (routing),Data mining,Evolutionary algorithm,Ranking,Rating system,Multi-objective optimization,Pareto optimal,Artificial intelligence,Confidence interval,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
55
C
1568-4946
Citations 
PageRank 
References 
11
0.48
24
Authors
3
Name
Order
Citations
PageRank
Miha Ravber1151.95
Marjan Mernik23256154.23
Matej Črepinšek371020.77