Utilisation of Embodied Agents in the Design of Smart Human–Computer Interfaces—A Case Study in Cyberspace Event Visualisation Control

Abstract

The goal of the research reported here was to investigate whether the design methodology utilising embodied agents can be applied to produce a multi-modal human–computer interface for cyberspace events visualisation control. This methodology requires that the designed system structure be defined in terms of cooperating agents having well-defined internal components exhibiting specified behaviours. System activities are defined in terms of finite state machines and behaviours parameterised by transition functions. In the investigated case the multi-modal interface is a component of the Operational Centre which is a part of the National Cybersecurity Platform. Embodied agents have been successfully used in the design of robotic systems. However robots operate in physical environments, while cyberspace events visualisation involves cyberspace, thus the applied design methodology required a different definition of the environment. It had to encompass the physical environment in which the operator acts and the computer screen where the results of those actions are presented. Smart human–computer interaction (HCI) is a time-aware, dynamic process in which two parties communicate via different modalities, e.g., voice, gesture, eye movement. The use of computer vision and machine intelligence techniques are essential when the human is carrying an exhausting and concentration demanding activity. The main role of this interface is to support security analysts and operators controlling visualisation of cyberspace events like incidents or cyber attacks especially when manipulating graphical information. Visualisation control modalities include visual gesture- and voice-based commands.

Cybersecurity of Robotic Systems: Leading Challenges and Robotic System Design Methodology

“…The control system is designed considering: (a) The definition of necessary real receptors and effectors which are essential for the system actions, (b) the decomposition of the system to the agents assigning to them the real effectors and receptors, (c) the determination of individual tasks of the agents, (d) the definition of each system component behavior (often the Finite State Machines (FSMs) are applied for this purpose), and (e) the specification of relevant parameters, i.e., state transition functions, terminal, and error conditions [107]. Each behavior is executed according to the actual tasks.…”

“…A design methodology was proposed using the experience gained from developing robotic systems using the real-time operating system QNX and ROS [29,107]. The concept has been proven to be versatile and efficient in various robots and in complex real-time scenarios.…”

“…Figure 4. Diagram of control subsystem module communicated with effectors and receptors (a); communicated only with other module (b).The idea is adopted from[3,107].…”