The contour fitting property of differential mutation
Karol Opara , Jarosław Arabas
AbstractState-of-the-art global optimization techniques adapt the search range and direction to the objective function. Differential Evolution algorithms perform this adaptation implicitly, leading to a contour fitting property which has been empirically observed, but lacks theoretical grounding. In this paper, we formalize the contour fitting notion and derive an analytical model that links the differential mutation operator with the adaptation of the range and direction of search. Our analysis uses the Differential Mutation Evolutionary Algorithm (DMEA), which optimizes the multidimensional Gaussian objective function. Through our analysis, we are able to make several observations. Firstly, a normally distributed population remains normal in consecutive iterations. Moreover, parameters of the population distribution can be updated with explicit algebraic formulas. Furthermore, for a scaling factor below a critical value, the population reaches a stable state. Finally, the covariance matrix of a population in a stable state is proportional to the covariance matrix of the Gaussian objective function. The analytical results explaining the contour fitting property are confirmed with a simulation study. Although this work focuses on theoretical analyses, the proposed DE/prop/1 mutation and DMEA algorithm maintain population diversity and therefore, can lead to optimization by means of saddle-crossing and can become a basis for adaptive Markov Chain Monte Carlo sampling schemes or an element of strategy adaptive differential evolution variants. The latter approach was tested on the CEC 2017 benchmark and found to significantly improve the performance of the SaDE algorithm.
|Journal series||Swarm and Evolutionary Computation, ISSN 2210-6502|
|Publication size in sheets||0.7|
|Keywords in English||Gaussian models, Differential Evolution, DE, Evolutionary algorithms, Mutation adaptation, Covariance matrix|
|Project||Development of new algorithms in the areas of software and computer architecture, artificial intelligence and information systems and computer graphics . Project leader: Arabas Jarosław,
, Phone: +48 22 234 7432, start date 01-08-2018, end date 30-09-2019, II/2018/DS/1, Completed
|Score||= 140.0, 04-09-2020, ArticleFromJournal|
|Publication indicators||= 0; = 1.0; = 0; : 2016 = 2.756; : 2018 = 6.33 (2) - 2018=6.242 (5)|
|Citation count*||1 (2020-08-24)|
* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.