Evaluating the User Experience of Human–Robot Interaction

The ANEMONE: Theoretical Foundations for UX Evaluation of Action and Intention Recognition in Human-Robot Interaction

“…Therefore, it is of major importance when designing and developing robots to systematically evaluate if humans can properly recognize the actions and intentions of robots in order to identify problems of robot usage in various kinds of human environments, e.g., offices, factories, hospitals, museums, and educational settings. The foreseen and increased level of robot participation in everyday human activities obviously emphasizes the role and relevance of systematically evaluating the interaction quality between the human user(s) and the robot(s) from a UX perspective [ 5 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 ]. Indeed, the prominent HRI scholar Dautenhahn [ 68 ] highlights that currently her greatest concern of empirical HRI research is that the field of experimental psychology appears repeatedly to be viewed as the ‘one and only’ and, accordingly, the golden standard method for performing proper HRI work.…”

“…Dautenhahn [ 68 ] admits that the above suggested HRI research approach does not fit well with the prevailing method paradigm of HRI studies greatly influenced by experimental psychology. Moreover, experimental HRI studies do not provide any explicit suggestions of how to overcome any identified problems in the interaction between humans and robots, and seldom consider the nature of the task(s) carried out, or to what extent the context of usage matters [ 64 ]. Dautenhahn [ 68 ] declares that she personally would like to see more empirical HRI studies that involve more authentic and less trivial interactions between humans and robots as well as encompassing more complex robot behaviors, which are carried out and situated within ecologically valid environments.…”

“…Hence, we suggest taking a UX view that comprises a systematic evaluation of the interaction quality between human(s) and robot(s) is of major concern in order for autonomous systems like various kinds of robots to offer long-term added values to people’s professional and private lifes. We argue that it is of major importance that socially interactive robots, in similar ways as any digitally interactive devices, services, and/or systems, achieve a positive or great user experience in order to accomplish the intended benefits and foreseen societal relevance of HRI in various usage settings [ 5 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 ]. Generally speaking, UX refers to the feelings that occur and unfold inside the human users during the usage of interactive technology in a particular context of use [ 69 , 70 , 71 , 72 ].…”

“…Generally speaking, UX refers to the feelings that occur and unfold inside the human users during the usage of interactive technology in a particular context of use [ 69 , 70 , 71 , 72 ]. If the usage of socially interactive robots causes a negative or bad user experience for the intended end-users in the context of use, it could result in several undesirable negative consequences, e.g., unwillingness to use the actual robot, incorrect handling, serious safety issues, perceived mistrust, or spreading of bad reputation of socially interactive robots in general [ 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 ].…”

Everyday automation experience: a research agenda

“…Insights into trust in automated demand-side management [21], novel interaction forms [68], end-user programming for smart home configuration [52], long-term user experience of automated ambient technology [23], and privacy aspects [75] Active and assisted living Many solutions for social robots and assistive functions have been introduced and investigated, but roll out on a large scale is pending Long-term acceptance aspects [13], individual differences in trust [61], human-robot interaction [37], and contextual design of digital assistants [2] approaches should feed into further instances of the above introduced preliminary design space that could help shape everyday automation experience into something desirable for the future.…”