The contour fitting property of differential mutation

Karol Opara , Jarosław Arabas

Abstract

State-of-the-art global optimization techniques adapt the search range and direction to the objective function. Differential Evolution algorithms perform this adaptation implicitly, leading to a contour fitting property which has been empirically observed, but lacks theoretical grounding. In this paper, we formalize the contour fitting notion and derive an analytical model that links the differential mutation operator with the adaptation of the range and direction of search. Our analysis uses the Differential Mutation Evolutionary Algorithm (DMEA), which optimizes the multidimensional Gaussian objective function. Through our analysis, we are able to make several observations. Firstly, a normally distributed population remains normal in consecutive iterations. Moreover, parameters of the population distribution can be updated with explicit algebraic formulas. Furthermore, for a scaling factor below a critical value, the population reaches a stable state. Finally, the covariance matrix of a population in a stable state is proportional to the covariance matrix of the Gaussian objective function. The analytical results explaining the contour fitting property are confirmed with a simulation study. Although this work focuses on theoretical analyses, the proposed DE/prop/1 mutation and DMEA algorithm maintain population diversity and therefore, can lead to optimization by means of saddle-crossing and can become a basis for adaptive Markov Chain Monte Carlo sampling schemes or an element of strategy adaptive differential evolution variants. The latter approach was tested on the CEC 2017 benchmark and found to significantly improve the performance of the SaDE algorithm.
Author Karol Opara (SRI)
Karol Opara,,
- Systems Research Institute
, Jarosław Arabas (FEIT / IN)
Jarosław Arabas,,
- The Institute of Computer Science
Journal seriesSwarm and Evolutionary Computation, ISSN 2210-6502, (N/A 140 pkt)
Issue year2019
Vol50
No100441
Pages1-15
Publication size in sheets0.7
Keywords in EnglishGaussian models, Differential Evolution, DE, Evolutionary algorithms, Mutation adaptation, Covariance matrix
ASJC Classification1700 General Computer Science; 2600 General Mathematics
DOIDOI:10.1016/j.swevo.2018.09.001
URL https://doi.org/10.1016/j.swevo.2018.09.001
ProjectDevelopment of new algorithms in the areas of software and computer architecture, artificial intelligence and information systems and computer graphics . Project leader: Arabas Jarosław, , Phone: +48 22 234 7432, start date 01-08-2018, end date 30-09-2019, II/2018/DS/1, Completed
WEiTI Działalność statutowa
Languageen angielski
File
1-s2.0-S1568494619301553-main (1).pdf 1.34 MB
Score (nominal)140
Score sourcejournalList
ScoreMinisterial score = 140.0, 12-01-2020, ArticleFromJournal
Publication indicators WoS Citations = 0; GS Citations = 1.0; Scopus SNIP (Source Normalised Impact per Paper): 2016 = 2.756; WoS Impact Factor: 2018 = 6.33 (2) - 2018=6.242 (5)
Citation count*1 (2020-01-10)
Cite
Share Share

Get link to the record


* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Back
Confirmation
Are you sure?