Investigation into the reliability of facial recognition systems under the simultaneous influences of mood variation and makeup

Mohammadreza Azimi , Andrzej Pacut


Facial recognition systems are increasingly popular and prevalent in our everyday lives, especially on mobile cell phones. This paper is an attempt to investigate the effects that makeup and facial expressions have on the reliability of such systems. While these factors have been shown not to be significant by themselves, it has not been clearly demonstrated whether a combination of both these factors can affect the matching accuracy of the same system in a statistically meaningful way. We carried out numerical experiments through two databases: Radboud Faces database and Psychological Image Collection at Stirling (PICS), using a state of the art algorithm, namely dlib. Then, in order to be able to reliably validate the results, we used two more algorithms (Verilook and VGGFace) to give similarity scores. The results showed that, while the effects of makeup and varied mood expressions are not significant by themselves, the joint effect is. An equal error rate (EER) of 4.68% was achieved when identifying faces under the joint influences of full makeup and mood variation, while the EER under the effect of each of these factors separately is less than 1%.

Author Mohammadreza Azimi (FEIT / AK)
Mohammadreza Azimi,,
- The Institute of Control and Computation Engineering
, Andrzej Pacut (FEIT / AK)
Andrzej Pacut,,
- The Institute of Control and Computation Engineering
Journal seriesComputers & Electrical Engineering, [Computers and Electrical Engineering], ISSN 0045-7906, e-ISSN 1879-0755
Issue year2020
ASJC Classification1700 General Computer Science; 2207 Control and Systems Engineering; 2208 Electrical and Electronic Engineering
Languageen angielski
Score (nominal)70
Score sourcejournalList
ScoreMinisterial score = 70.0, 27-08-2020, ArticleFromJournal
Publication indicators Scopus Citations = 0; Scopus SNIP (Source Normalised Impact per Paper): 2018 = 1.395; WoS Impact Factor: 2018 = 2.189 (2) - 2018=2.337 (5)
Citation count*
Share Share

Get link to the record

* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Are you sure?