Utilisation of Embodied Agents in the Design of Smart Human–Computer Interfaces—A Case Study in Cyberspace Event Visualisation Control

Wojciech Szynkiewicz , Włodzimierz Kasprzak , Cezary Zieliński , Wojciech Dudek , Maciej Stefańczyk , Artur Wilkowski , Maksym Figat


The goal of the research reported here was to investigate whether the design methodology utilising embodied agents can be applied to produce a multi-modal human–computer interface for cyberspace events visualisation control. This methodology requires that the designed system structure be defined in terms of cooperating agents having well-defined internal components exhibiting specified behaviours. System activities are defined in terms of finite state machines and behaviours parameterised by transition functions. In the investigated case the multi-modal interface is a component of the Operational Centre which is a part of the National Cybersecurity Platform. Embodied agents have been successfully used in the design of robotic systems. However robots operate in physical environments, while cyberspace events visualisation involves cyberspace, thus the applied design methodology required a different definition of the environment. It had to encompass the physical environment in which the operator acts and the computer screen where the results of those actions are presented. Smart human–computer interaction (HCI) is a time-aware, dynamic process in which two parties communicate via different modalities, e.g., voice, gesture, eye movement. The use of computer vision and machine intelligence techniques are essential when the human is carrying an exhausting and concentration demanding activity. The main role of this interface is to support security analysts and operators controlling visualisation of cyberspace events like incidents or cyber attacks especially when manipulating graphical information. Visualisation control modalities include visual gesture- and voice-based commands.
Author Wojciech Szynkiewicz (FEIT / AK)
Wojciech Szynkiewicz,,
- The Institute of Control and Computation Engineering
, Włodzimierz Kasprzak (FEIT / AK)
Włodzimierz Kasprzak,,
- The Institute of Control and Computation Engineering
, Cezary Zieliński (FEIT / AK)
Cezary Zieliński,,
- The Institute of Control and Computation Engineering
, Wojciech Dudek (FEIT / AK)
Wojciech Dudek,,
- The Institute of Control and Computation Engineering
, Maciej Stefańczyk (FEIT / AK)
Maciej Stefańczyk,,
- The Institute of Control and Computation Engineering
, Artur Wilkowski (FEIT / AK)
Artur Wilkowski,,
- The Institute of Control and Computation Engineering
, Maksym Figat (FEIT / AK)
Maksym Figat,,
- The Institute of Control and Computation Engineering
Journal seriesElectronics (Switzerland), [Electronics (Switzerland)], ISSN 2079-9292, e-ISSN 2079-9292
Issue year2020
Publication size in sheets48.8
Article number976
Keywords in Englishembodied agent; gesture/face recognition; speech/speaker recognition; system design methodology; network event visualisation
ASJC Classification1705 Computer Networks and Communications; 1708 Hardware and Architecture; 1711 Signal Processing; 2207 Control and Systems Engineering; 2208 Electrical and Electronic Engineering
URL https://www.mdpi.com/2079-9292/9/6/976
ProjectNational Cybersecurity Platform. Project leader: Niewiadomska-Szynkiewicz Ewa, , Phone: 3650, start date 01-09-2017, planned end date 31-08-2020, IA/NPC/2017, Implemented
WEiTI Projects financed by NCRD [Projekty finansowane przez NCBiR (NCBR)]
Languageen angielski
eSzynkiewiczW i in Electronics-2020.pdf 8.8 MB
Score (nominal)100
Score sourcejournalList
ScoreMinisterial score = 100.0, 22-09-2020, ArticleFromJournal
Publication indicators WoS Citations = 0; Scopus SNIP (Source Normalised Impact per Paper): 2018 = 1.076; WoS Impact Factor: 2018 = 1.764 (2)
Citation count*
Share Share

Get link to the record

* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Are you sure?