Communication of Hazards in Mixed-Reality Telerobotic Systems: The Usage of Naturalistic Avoidance Cues in Driving Tasks

Abstract

Objective This study investigates the effect of naturalistic visual cues on human avoidance behavior for a potential use in telerobotic user interfaces incorporating mixed-reality environments (e.g., augmented reality). Background Telerobotic systems used in hazardous environments require interfaces that draw operators’ attention to potential dangers. Existing means of hazard notification can often distract or induce stress in operators. In the design and implementation of such interfaces, visual semiotics plays a critical role in creating more effective interfaces. Naturalistic visual cues such as Aposematism or Kindchenschema have proven effective to communicate danger or caution in nature, but the application of these cues in visual systems have yet to be thoroughly investigated. Method A study was conducted where 40 volunteering participants were asked to control a remote vehicle in a simulated environment. The environment contained a set of neutral and visually augmented obstacles that were designed to provoke avoidance behavior. Results The use of visual cues triggered greater avoidance behaviors in participants compared to neutral obstacles. The distance of avoidance was correlated with the type of cue present, with obstacles augmented by Aposematism (Cue A) having a greater participant–obstacle distance than Kindchenschema (Cue K). Conclusions This study shows the potential for the incorporation of naturalistic visual cues as a means to designate warning or caution in telerobotic environments. Applications The findings can offer practical guidelines for the design of visual cues in telerobotic interfaces. The further incorporation of such cues may reduce operator stress and the amount of human errors in telerobotic operations.

Simulation Components in Gazebo

“…MR has been used in industrial settings (see, e.g., [7]. In addition, A MR study on human behavior based on a Gazebo simulation is presented in [8]. The MirrorLabs project features the development of MR applications primarily for educational purposes [9].…”