Prior Knowledge Facilitates Mutual Gaze Convergence and Head Nodding Synchrony in Face-to-face Communication

Thepsoonthorn, Chidchanok; Yokozuka, Takahiro; Miura, Shunsuke; Ogawa, Kyosuke; Miyake, Yoichi

doi:10.1038/srep38261

Cited by 20 publications

(18 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We selected this degree and interval of gaze shifting because in our pilot study, the participants reported that it is perceived as gaze breaking enough while it is not too eerie to distract the participants during the interaction, which is a good choice to be considered as a substitution of eyeballs averting in our study. This behaviour will be activated when the robot can detect human face at the middle of its camera vision frame continuously for more than 3, 5, 7, or 9 seconds (randomly) to avert its gaze direction from interactional partner according to our previous studies 59 , 60 , which suggest that human has momentary mutual gaze convergence or fixation at their partner both in face-to-face communication and collaborative task.…”

Section: Methodsmentioning

confidence: 98%

“…According to human’s head nodding behaviour, humans do not only unconsciously have head nodding synchrony with their interactional partner 40 , 59 , 61 , 62 , but also initiates own nodding 38 and responds to interactional partner’s head nodding as backchanneling behaviour as well 33 . We then applied such head nodding behaviour to NAO Robot.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

The Relationship between Robot’s Nonverbal Behaviour and Human’s Likability Based on Human’s Personality

Thepsoonthorn

Ogawa

Miyake

2018

Sci Rep

View full text Add to dashboard Cite

At current state, although robotics technology has been immensely developed, the uncertainty to completely engage in human-robot interaction is still growing among people. Many current studies then started to concern about human factors that might influence human’s likability like human’s personality, and found that compatibility between human’s and robot’s personality (expressions of personality characteristics) can enhance human’s likability. However, it is still unclear whether specific means and strategy of robot’s nonverbal behaviours enhances likability from human with different personality traits and whether there is a relationship between robot’s nonverbal behaviours and human’s likability based on human’s personality. In this study, we investigated and focused on the interaction via gaze and head nodding behaviours (mutual gaze convergence and head nodding synchrony) between introvert/extravert participants and robot in two communication strategies (Backchanneling and Turn-taking). Our findings reveal that the introvert participants are positively affected by backchanneling in robot’s head nodding behaviour, which results in substantial head nodding synchrony whereas the extravert participants are positively influenced by turn-taking in gaze behaviour, which leads to significant mutual gaze convergence. This study demonstrates that there is a relationship between robot’s nonverbal behaviour and human’s likability based on human’s personality.

show abstract

Section: Methodsmentioning

confidence: 98%

Section: Methodsmentioning

confidence: 99%

The Relationship between Robot’s Nonverbal Behaviour and Human’s Likability Based on Human’s Personality

Thepsoonthorn

Ogawa

Miyake

2018

Sci Rep

View full text Add to dashboard Cite

show abstract

“…We analyzed the time-series data on head motion acceleration of each participant to detect synchronization using the method described by Thepsoonthorn et al (2016) . This method consists of three main steps.…”

Section: Methodsmentioning

confidence: 99%

The Relationship Between Head Motion Synchronization and Empathy in Unidirectional Face-to-Face Communication

et al. 2018

View full text Add to dashboard Cite

Embodied synchronization is widely observed in human communication, and is considered to be important in generating empathy during face-to-face communication. However, the quantitative relationship between body motion synchronization and degree of empathy is not fully understood. Therefore, we focused on head motion to investigate phase and frequency differences in head motion synchronization in relation to degree of empathy. We specifically conducted a lecture-based experiment using controlled spoken text divided into two parts: high empathy and low empathy. During the lecture, we measured the acceleration of speakers’ and listeners’ head motions using an accelerometer, and calculated the synchronization between the time-series data from their acceleration norms. The results showed greater head motion synchronization during high empathy. During high empathy, the speakers’ head motions began before those of listeners’ in the medium (2.5 to 3.5 Hz) and high (4.0 to 5.0 Hz) frequency ranges, whereas the speakers’ head motions tended to start later than those of the listeners’ in the low (1.0 to 2.0 Hz) and medium (2.5 to 3.5 Hz) frequency ranges. This suggests that the degree of empathy is reflected by a different relationship between the phase and frequency of head motion synchronization during face-to-face communication.

show abstract

“…From the pool of 18 participants, two with instructor training (Educational Sciences) for at least 2 years were selected and assigned as instructors. Only two instructors were used in order to make the teaching style as similar as possible across dyads (Thepsoonthorn et al, 2016). The remaining 16 participants were learners, 6 randomly assigned to the 2 instructors.…”

Section: Participantsmentioning

confidence: 99%

Interpersonal brain synchronization with instructor compensates for learner’s sleep deprivation in interactive learning

Pan

Guyon

Borragán

et al. 2020

Preprint

View full text Add to dashboard Cite

Recent advances shifted the focus on single-brain functioning toward two-brain communication during learning interactions, following the demonstration that interpersonal brain synchronization (IBS) can track instructor-learner information exchange. Here, we investigated (i) whether sleep deprivation (SD) that potentially impacts both social interactions and learning abilities modulates IBS, and (ii) conversely whether and to what extent IBS might compensate for SD-related learning deficits. Instructors (always with regular sleep, RS) were asked to teach numerical reasoning strategies to learners (either SD or RS), during which the activity of both brains was simultaneously recorded using functional near-infrared spectroscopy (fNIRS). SD learners initially performed below their baseline level, worse than RS learners, but learning improvement was comparable between RS and SD conditions after learning with the instructor. IBS within the instructor-learner dyads was higher in the SD (vs. RS) condition in the left inferior frontal cortex. In addition, clustered IBS (estimated by nonnegative matrix factorization) was correlated with performance improvement. Moreover, Granger Causality analyses revealed biased causality with higher instructor-to-learner than learner-to-instructor directionality in brain signal processing. Together, these results indicate that SD-related learning deficits can to some extent be compensated via interactions with an instructor, as reflected by increased IBS and preserved learning ability, and implicate an essential role of the instructor in driving synchrony between teaching and SD learning brains during interactions.

show abstract

Prior Knowledge Facilitates Mutual Gaze Convergence and Head Nodding Synchrony in Face-to-face Communication

Cited by 20 publications

References 38 publications

The Relationship between Robot’s Nonverbal Behaviour and Human’s Likability Based on Human’s Personality

The Relationship between Robot’s Nonverbal Behaviour and Human’s Likability Based on Human’s Personality

The Relationship Between Head Motion Synchronization and Empathy in Unidirectional Face-to-Face Communication

Interpersonal brain synchronization with instructor compensates for learner’s sleep deprivation in interactive learning

Contact Info

Product

Resources

About