The OMG-Empathy Dataset: Evaluating the Impact of Affective Behavior in Storytelling

Abstract

Processing human affective behavior is important for developing intelligent agents that interact with humans in complex interaction scenarios. A large number of current approaches that address this problem focus on classifying emotion expressions by grouping them into known categories. Such strategies neglect, among other aspects, the impact of the affective responses from an individual on their interaction partner thus ignoring how people empathize towards each other. This is also reflected in the datasets used to train models for affective processing tasks. Most of the recent datasets, in particular, the ones which capture natural interactions ("in-the-wild" datasets), are designed, collected, and annotated based on the recognition of displayed affective reactions, ignoring how these displayed or expressed emotions are perceived. In this paper, we propose a novel dataset composed of dyadic interactions designed, collected and annotated with a focus on measuring the affective impact that eight different stories have on the listener. Each video of the dataset contains around 5 minutes of interaction where a speaker tells a story to a listener. After each interaction, the listener annotated, using a valence scale, how the story impacted their affective state, reflecting how they empathized with the speaker as well as the story. We also propose different evaluation protocols and a baseline that encourages participation in the advancement of the field of artificial empathy and emotion contagion.

Empathy and Criativity in Privacy Requirements Elicitation: Systematic Literature Review

“…In addition, several authors use creative techniques to elicit requirements during the agile software development process [21], [46], [40], [27], [44], [59]. It is possible to find relevant works that address requirements elicitation and Empathy in general [60], [9], [20], [29], [62], [54], [4], [61]. Levy and Hadar [38] reinforce the need for Empathy with end users by stating that this is a requirement engineering skill as necessary as technical knowledge and social competence.…”

"In Storytelling, We See the Performance More from the Personality": The Goals and Self-Regulation on Storytellers of Other-Language

“…Moreover, storytellers have their own ways to communicate through the interaction with the audience. The existence of intelligent agents in human affective behavior has been developed to transform human complex interaction in scenarios (Barros et al, 2019). The use of many styles of delivery performance and genres in storytelling has created a significant impact both for the audience and the storyteller.…”

Modeling User Empathy Elicited by a Robot Storyteller

“…We leverage insights from the literature on empathy, narrative empathy, and storytelling to inform the design of our empirical study to model elicited user empathy during interactions with a robot storyteller. While there has been prior research on elicited empathy in human-human storytelling interactions [18], to the best of our knowledge, there has been no prior study on user empathy elicited in human-robot interactions with a robot storyteller.…”