Utilisation of Embodied Agents in the Design of Smart Human–Computer Interfaces—A Case Study in Cyberspace Event Visualisation Control
Wojciech Szynkiewicz , Włodzimierz Kasprzak , Cezary Zieliński , Wojciech Dudek , Maciej Stefańczyk , Artur Wilkowski , Maksym Figat
AbstractThe goal of the research reported here was to investigate whether the design methodology utilising embodied agents can be applied to produce a multi-modal human–computer interface for cyberspace events visualisation control. This methodology requires that the designed system structure be defined in terms of cooperating agents having well-defined internal components exhibiting specified behaviours. System activities are defined in terms of finite state machines and behaviours parameterised by transition functions. In the investigated case the multi-modal interface is a component of the Operational Centre which is a part of the National Cybersecurity Platform. Embodied agents have been successfully used in the design of robotic systems. However robots operate in physical environments, while cyberspace events visualisation involves cyberspace, thus the applied design methodology required a different definition of the environment. It had to encompass the physical environment in which the operator acts and the computer screen where the results of those actions are presented. Smart human–computer interaction (HCI) is a time-aware, dynamic process in which two parties communicate via different modalities, e.g., voice, gesture, eye movement. The use of computer vision and machine intelligence techniques are essential when the human is carrying an exhausting and concentration demanding activity. The main role of this interface is to support security analysts and operators controlling visualisation of cyberspace events like incidents or cyber attacks especially when manipulating graphical information. Visualisation control modalities include visual gesture- and voice-based commands.
|Journal series||Electronics (Switzerland), [Electronics (Switzerland)], ISSN 2079-9292, e-ISSN 2079-9292|
|Publication size in sheets||48.8|
|Keywords in English||embodied agent; gesture/face recognition; speech/speaker recognition; system design methodology; network event visualisation|
|ASJC Classification||; ; ; ;|
|Project||National Cybersecurity Platform. Project leader: Niewiadomska-Szynkiewicz Ewa,
, Phone: 3650, start date 01-09-2017, planned end date 31-08-2020, IA/NPC/2017, Implemented
|Score||= 100.0, 22-09-2020, ArticleFromJournal|
|Publication indicators||= 0; : 2018 = 1.076; : 2018 = 1.764 (2)|
* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.