Can You Hear My Heartbeat?: Hearing an Expressive Biosignal Elicits Empathy

Winters, R. Michael; Walker, Bruce N.; Leslie, Grace

doi:10.1145/3411764.3445545

Cited by 21 publications

(16 citation statements)

References 99 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We also consider potential lines of future research which stem from our design discussions and the novel contexts explored in our work. Embodied social cognition through technology can explore flexible multisensory methods (e.g., combinations or subsets of haptic [43], sonic [93], olfactory [73], and visual [46] technologies) if future research sheds more light on how specific perceptual cues from virtual embodiment relate to social cognition [10,35,50]. We saw hints of this from REPT participants referring to specifically head and hand movements as triggering cues in our findings.…”

Section: Limitations and Future Workmentioning

confidence: 65%

A Change of Scenery: Transformative Insights from Retrospective VR Embodied Perspective-Taking of Conflict With a Close Other

Yong,

Cui,

Suma Rosenberg

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Close relationships are irreplaceable social resources, yet prone to high-risk conflict. Building on findings from the fields of HCI, virtual reality, and behavioral therapy, we evaluate the unexplored potential of retrospective VR-embodied perspective-taking to fundamentally influence conflict resolution in close others. We develop a biographically-accurate Retrospective Embodied Perspective-Taking system (REPT) and conduct a mixed-methods evaluation of its influence on close others' reflection and communication, compared to video-based reflection methods currently used in therapy (treatment as usual, or TAU). Our key findings provide evidence that REPT was able to significantly improve communication skills and positive sentiment of both partners during conflict, over TAU. The qualitative data also indicated that REPT surpassed basic perspective-taking by exclusively stimulating users to embody and reflect on both their own and their partner's experiences at the same level. In light of these findings, we provide implications and an agenda for social embodiment in HCI design: conceptualizing the use of 'embodied social cognition,' and envisioning socially-embodied experiences as an interactive context. CCS CONCEPTS• Human-centered computing → Empirical studies in collaborative and social computing; Collaborative and social computing devices; Interaction techniques; • Applied computing → Psychology.

show abstract

Section: Limitations and Future Workmentioning

confidence: 65%

A Change of Scenery: Transformative Insights from Retrospective VR Embodied Perspective-Taking of Conflict With a Close Other

Yong,

Cui,

Suma Rosenberg

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…The advantage of face images in empathy revealed in our current study was in line with the study conducted by Salminen et al 17 , that investigated how image styles affected user perceptions of personas and found higher perception of empathy for a persona with real face images as compared to no pictures. This advantage may be attributed to the eyes region in the face image, considering that cognitive empathy refers to understand others' emotion statement involving cognitive process 30 and highly correlates to so called perspective taking 33 , which refers to the ability to consciously put oneself into the mind of another person to understand what she/he is thinking or feeling and is usually measured by the Reading the Mind in the Eyes Task (RMET) 34,35 . The attribution of the eyes region also explained why the advantage of cartoon face images disappeared in the online experiment, in where the size of the cartoon face profile photo used as stimuli was smaller, resulting a smaller corresponding eye region and lower cognitive empathy rating.…”

Section: Discussionmentioning

confidence: 99%

How to Evoke Empathetic Experience and Deepen Impression: The role of profile pictures in social media

Liu

Zhou

et al. 2022

Preprint

View full text Add to dashboard Cite

Profile pictures are perceived as a form of social identity and individuals often engage in similar categorization processes. Profile pictures in social media represent virtual identities in online social networks and embody personal impression. The influence of profile picture styles on empathy plays an important role in the design and user experience of social media. However, the potential impact of profile pictures with different image styles (e.g., cartoon faces, real faces, or non-face images) on the perception of users in social media is still unclear. To investigate this impact, a controlled laboratory experiment (48 participants) and an ecological online experiment (184 participants) were conducted. Results show that participants’ empathic experience for users choosing cartoon faces or real faces as profile pictures are greater than that for users choosing non-face images. Besides, participants performed better in identity recognition for users choosing real face or non-face images than those choosing cartoon faces. Increasing empathic experience was associated with the degree to which users choosing profile pictures are categorized as ingroup members. Users of social media often make social categorizations (i.e., ingroup/outgroup categorization) based on the social identities expressed by their profile pictures. Our results also showed that increasing empathic experience was associated with the degree to which users choosing profile pictures are categorized as ingroup members.

show abstract

“…Furthermore, visual information of body postures is often lost due to the limited field of view of the camera (Khamis et al, 2018;Tag et al, 2022a;Sarsenbayeva et al, 2020). However, prior works have shown that the accessibility of biosignal data, e.g., heartbeat information, potentially increases empathy levels of users who are deaf or hard of hearing, thus offering solutions to this problem (Winters et al, 2021).…”

Section: Accessibility Research Roadmapmentioning

confidence: 99%