The contour fitting property of differential mutation

Karol Opara , Jarosław Arabas

Abstract

State-of-the-art global optimization techniques adapt the search range and direction to the objective function. Differential Evolution algorithms perform this adaptation implicitly, leading to a contour fitting property which has been empirically observed, but lacks theoretical grounding. In this paper, we formalize the contour fitting notion and derive an analytical model that links the differential mutation operator with the adaptation of the range and direction of search. Our analysis uses the Differential Mutation Evolutionary Algorithm (DMEA), which optimizes the multidimensional Gaussian objective function. Through our analysis, we are able to make several observations. Firstly, a normally distributed population remains normal in consecutive iterations. Moreover, parameters of the population distribution can be updated with explicit algebraic formulas. Furthermore, for a scaling factor below a critical value, the population reaches a stable state. Finally, the covariance matrix of a population in a stable state is proportional to the covariance matrix of the Gaussian objective function. The analytical results explaining the contour fitting property are confirmed with a simulation study. Although this work focuses on theoretical analyses, the proposed DE/prop/1 mutation and DMEA algorithm maintain population diversity and therefore, can lead to optimization by means of saddle-crossing and can become a basis for adaptive Markov Chain Monte Carlo sampling schemes or an element of strategy adaptive differential evolution variants. The latter approach was tested on the CEC 2017 benchmark and found to significantly improve the performance of the SaDE algorithm.
Author Karol Opara (SRI)
Karol Opara,,
- Systems Research Institute
, Jarosław Arabas (FEIT / IN)
Jarosław Arabas,,
- The Institute of Computer Science
Journal seriesSwarm and Evolutionary Computation, ISSN 2210-6502, (A 50 pkt)
Issue year2019
Pages1-15
Publication size in sheets0.7
Keywords in EnglishGaussian modelsDifferential EvolutionDEEvolutionary algorithmsMutation adaptationCovariance matrix
ASJC Classification2600 General Mathematics; 1700 General Computer Science
DOIDOI:10.1016/j.swevo.2018.09.001
URL https://doi.org/10.1016/j.swevo.2018.09.001
projectDevelopment of new algorithms in the areas of software and computer architecture, artificial intelligence and information systems and computer graphics . Project leader: Arabas Jarosław, , Phone: +48 22 234 7432, start date 01-08-2018, planned end date 30-09-2019, II/2018/DS/1, Implemented
WEiTI Działalność statutowa
Languageen angielski
File
1-s2.0-S1568494619301553-main (1).pdf 1.34 MB
Score (nominal)50
ScoreMinisterial score = 50.0, 22-04-2019, ArticleFromJournal
Ministerial score (2013-2016) = 50.0, 22-04-2019, ArticleFromJournal
Publication indicators Scopus SNIP (Source Normalised Impact per Paper): 2016 = 2.756; WoS Impact Factor: 2017 = 3.818 (2) - 2017=4.607 (5)
Citation count*
Cite
Share Share

Get link to the record


* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Back