Interaction design patterns for coherent and re-usable shape specifications of human-robot collaboration

Abstract

Sharing and re-using design knowledge is a challenge for the diverse multi-disciplinary research and development teams that work on complex and highly automated systems. For this purpose, a situated Cognitive Engineering (sCE) methodology was proposed that specifies and assesses the functional user requirements with their design rationale in a coherent and concise way. This paper presents this approach for the development of human-robot collaboration, focusing on a recently added component: the application of interaction design patterns to capture and share design knowledge on the shape of the human-robot interaction (i.e., the communication level). The sCE case study in the urban search and rescue domain provided the specification and assessment of functions and shape of a team-awareness display. Twenty fire fighters participated as operator of a ground or aerial robot, in several realistic earth quake scenarios to assess the functions and shapes of this display in different settings. It showed that the functions (i.e., the task level requirements and rationale) were valid, while the shape (communication level) was (yet) suboptimal. Based on this evaluation result, a design improvement on the communication level has been proposed without the need to adjust the task-level design solution.

Patterns for Representing Knowledge Graphs to Communicate Situational Knowledge of Service Robots

“…Pattern language was frst proposed by Alexander in 1977 [1], and then thrived in the feld of Human computer interaction(HCI) [46,51] and human robot interaction(HRI) [23,39,49]. Kahn et al argued that design patterns could beneft HRI by providing designers with the necessary knowledge and save their time when reusing these patterns to solve recurring problems [22].…”

Mode Awareness Interfaces in Automated Vehicles, Robotics, and Aviation: A Literature Review

“…In the domains of AD and AVI, mode information is most commonly presented with verbal indicators on a display [2,12,31,32,44,53,59,61,71,87,88,91,94]. In the field of HRI, interfaces are used when the robot and human are located in different environments, such as in the cases of collaboration between human and a rescue robots [64,65,85]. Even though, using verbal indicators is a common approach, there is no common terminology for stating modes.…”

“…These are flashing of icons or light [15,19,32,37,79,86], animation of visuals [53], pop-up displays [17] and exclamation mark at the of sentences [2,36,44]. Also change of color, especially red to draw immediate attention [61,65] is a common approach to draw attention in all three domains [2,3,13,26,27,33,36,44,89].…”

Patterns for Representing Knowledge Graphs to Communicate Situational Knowledge of Service Robots

“…Pattern language was first proposed by Alexander in 1977 [1], and then thrived in the field of Human computer interaction(HCI) [46,51] and human robot interaction(HRI) [23,39,49]. Kahn et al argued that design patterns could benefit HRI by providing designers with the necessary knowledge and save their time when reusing these patterns to solve recurring problems [22].…”