One contribution of 17 to a theme issue 'From social brains to social robots: applying neurocognitive insights to human -robot interaction'.We present a novel functional magnetic resonance imaging paradigm for second-person neuroscience. The paradigm compares a human social interaction (human-human interaction, HHI) to an interaction with a conversational robot (human-robot interaction, HRI). The social interaction consists of 1 min blocks of live bidirectional discussion between the scanned participant and the human or robot agent. A final sample of 21 participants is included in the corpus comprising physiological (blood oxygen leveldependent, respiration and peripheral blood flow) and behavioural (recorded speech from all interlocutors, eye tracking from the scanned participant, face recording of the human and robot agents) data. Here, we present the first analysis of this corpus, contrasting neural activity between HHI and HRI. We hypothesized that independently of differences in behaviour between interactions with the human and robot agent, neural markers of mentalizing (temporoparietal junction (TPJ) and medial prefrontal cortex) and social motivation (hypothalamus and amygdala) would only be active in HHI. Results confirmed significantly increased response associated with HHI in the TPJ, hypothalamus and amygdala, but not in the medial prefrontal cortex. Future analysis of this corpus will include fine-grained characterization of verbal and non-verbal behaviours recorded during the interaction to investigate their neural correlates.This article is part of the theme issue 'From social brains to social robots: applying neurocognitive insights to human -robot interaction'.
Mimicry has been ascribed affiliative functions. In three experiments, we used a newly developed social-affective mimicry task (SAMT) to investigate mimicry´s modulation by emotional facial expressions (happy, angry) and ethnic group-membership (White in-group, Black out-group). Experiment 1 established the main consistent effect across experiments, which was enhanced mimicry to angry out-group faces compared to angry in-group faces. Hence the SAMT was useful for experimentally investigating the modulation of mimicry. Experiment 2 demonstrated that these effects were not confounded by general aspects of response conflict, as a Simon task resulted in different response patterns than the SAMT. Experiment 2 and pooled analysis of Experiments 1 and 2 also corroborated the finding of enhanced mimicry to angry out-group faces. Experiment 3 tested whether this effect was related to perceptions of threat, by framing angry persons as physically threatening, or not. Selective enhancement of mimicry to out-group persons framed as physically threatening confirmed this hypothesis. Further support for the role of threat was derived from implicit measures showing, in all experiments, that black persons were more strongly associated with threat. Furthermore, enhanced mimicry was consistently related to response facilitation in the execution of congruent movements. This suggests that mimicry acted as a social congruency signal. Our findings suggest that mimicry may serve as an appeasement signal in response to negative affiliative intent. This extends previous models of mimicry, which have predominantly focused on its role in reciprocating affiliation. It suggests that mimicry might not only be used to maintain and establish affiliative bonds, but also to ameliorate a negative social situation.
Highlights
Interpersonal motor alignment (IMA) has positive effects on healthy social life.
IMA - mimicry, synchrony, automatic imitation - is studied throughout development.
It relies on motor resonance brain mechanisms identified throughout development.
It is modulated by contextual and personal factors.
IMA is underinvestigated in adolescence, yet it may aid to enhance resilience.
This study investigated neural processes underlying automatic imitation and its modulation by ethnically diverse hand stimuli (Black, White) using event-related brain potentials (ERPs). Automatic imitation relies on motor stimulus-response compatibility (SRC), i.e., response conflict caused by motoric (in)congruency between task-irrelevant hand stimuli and the required response. Our novel task aimed to separate two distinct neuro-cognitive processing stages of automatic imitation and its modulation by ethnicity: the stage of stimulus processing (i.e. perception), comprising presentation of stimulus ethnicity and SRC, and the stage of response execution (i.e. action). Effects of ethnicity were observed in ERPs of different stages of stimulus processing - during presentation of ethnicity (LPP) and SRC (N190, P3). ERPs at response execution, Pre-Motion Positivity (PMP) and Reafferent Potential (RAP), were only sensitive to congruency. The N190 results may index visual self-other distinction, while the neural timecourse of P3 and PMP variation could reflect a dynamical decision process linking perception to action, with motor initiation reflected in the PMP component. The PMP might further index motor-related self-other distinction regardless of ethnicity. Importantly, overt motor execution was not influenced by ethnically diverse stimuli, which suggests generalizability of the automatic imitation effect across ethnicities.
We present an approach to objectify the social competence of artificial agents using human brain neurophysiology. Whole brain activity is recorded with functional Magnetic Resonance Imaging (fMRI) while participants discuss either with a human confederate or an artificial agent. This allows a direct comparison of local brain responses, including deep brain structures invisible to other neuroimaging techniques, as a function of the nature of the interlocutor. The present data (9 participants, artificial agent is the robotic conversational head Furhat controlled with a Wizard of Oz procedure) demonstrates the feasibility of this approach, and results confirm an increased activity in the hypothalamic region when interacting with a human compared to an artificial agent.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.