Look at you, look at me: Detection and analysis of mutual gaze convergence in face-to-face interaction

Thepsoonthorn, Chidchanok; Yokozuka, Takahiro; Kwon, Jinhwan; Yap, Robin Miao Sin; Miura, Shunsuke; Ogawa, Kazuhiko; Miyake, Yoichi

doi:10.1109/sii.2015.7405044

Cited by 5 publications

(4 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We use web cameras and glasses cameras as tools to capture interactants’ gaze behaviors. Mutual gaze convergence detection method consists of 5 main processes: eye detection, looking straight identification, partner face detection, gaze direction detection, and mutual gaze convergence inference, executing in sequence45.…”

Section: Methodsmentioning

confidence: 99%

Prior Knowledge Facilitates Mutual Gaze Convergence and Head Nodding Synchrony in Face-to-face Communication

Thepsoonthorn

Yokozuka

Miura

et al. 2016

Sci Rep

View full text Add to dashboard Cite

As prior knowledge is claimed to be an essential key to achieve effective education, we are interested in exploring whether prior knowledge enhances communication effectiveness. To demonstrate the effects of prior knowledge, mutual gaze convergence and head nodding synchrony are observed as indicators of communication effectiveness. We conducted an experiment on lecture task between lecturer and student under 2 conditions: prior knowledge and non-prior knowledge. The students in prior knowledge condition were provided the basic information about the lecture content and were assessed their understanding by the experimenter before starting the lecture while the students in non-prior knowledge had none. The result shows that the interaction in prior knowledge condition establishes significantly higher mutual gaze convergence (t(15.03) = 6.72, p < 0.0001; α = 0.05, n = 20) and head nodding synchrony (t(16.67) = 1.83, p = 0.04; α = 0.05, n = 19) compared to non-prior knowledge condition. This study reveals that prior knowledge facilitates mutual gaze convergence and head nodding synchrony. Furthermore, the interaction with and without prior knowledge can be evaluated by measuring or observing mutual gaze convergence and head nodding synchrony.

show abstract

Section: Methodsmentioning

confidence: 99%

Prior Knowledge Facilitates Mutual Gaze Convergence and Head Nodding Synchrony in Face-to-face Communication

Thepsoonthorn

Yokozuka

Miura

et al. 2016

Sci Rep

View full text Add to dashboard Cite

show abstract

“…Nowadays, gaze, is one of the most significant, reliable, and observable indicators of non-verbal communication, and has been used in various studies to interpret the social behaviors of children with autism [44,52]. Converging evidence suggests that impairments in visual attention, including poor social gaze or lack of mutual gaze to caregivers, over-focused attention, or inattention to tasks, are often reported in children with autism from a very young age [14,24].…”

Section: Related Work 21 Autism and Mutual Gazementioning

confidence: 99%

“…Converging evidence suggests that impairments in visual attention, including poor social gaze or lack of mutual gaze to caregivers, over-focused attention, or inattention to tasks, are often reported in children with autism from a very young age [14,24]. Previous studies suggest that mutual attentiveness is essential for successful dyadic interactions during human face-to-face communication [44,52]. To this end, tracking the gaze interaction among the children with autism and other people during the therapy/training period can provide therapists with the possibility to investigate children's behaviors and analyze the effectiveness of their treatment.…”

Section: Related Work 21 Autism and Mutual Gazementioning

confidence: 99%

An Automated Mutual Gaze Detection Framework for Social Behavior Assessment in Therapy for Children with Autism

Zhang

Kim

Bhat

et al. 2021

Proceedings of the 2021 International Conference on Multimodal Interaction

View full text Add to dashboard Cite

Figure 1: Sample scenes captured from two therapy groups in our ASD dataset: (a) Standard therapy group with reading activity, and Play therapy group with (b) drumming, and (c) singing activity. Mutual gaze features are shown in (b) and (c), while no mutual gaze for child is detected in (a). Our paper aims to automatically capture mutual gaze attentiveness of children with autism, and develop a predictive model for their social visual behavior.

show abstract

“…In past research, the concept of GC has been mainly investigated in terms of mutual GC, often referring to people looking at each other (e.g., Thepsoonthorn et al [16]). These works are mostly focused on face-to-face communication between avatars (e.g., Wang et al [17]), between robots and humans (e.g., Thepsoonthorn et al [18]), and between humans (e.g., Thepsoonthorn et al [19]; Thepsoonthorn et al [16]). Clearly, HCI research on GC during collaborative system use is still embryonic, and the question as to how to measure it remains unexplored.…”

Section: Gaze Convergencementioning

confidence: 99%

Collaborative Use of a Shared System Interface: The Role of User Gaze—Gaze Convergence Index Based on Synchronous Dual-Eyetracking

et al. 2020

View full text Add to dashboard Cite

Gaze convergence of multiuser eye movements during simultaneous collaborative use of a shared system interface has been proposed as an important albeit sparsely explored construct in human-computer interaction literature. Here, we propose a novel index for measuring the gaze convergence of user dyads and address its validity through two consecutive eye-tracking studies. Eye-tracking data of user dyads were synchronously recorded while they simultaneously performed tasks on shared system interfaces. Results indicate the validity of the proposed gaze convergence index for measuring the gaze convergence of dyads. Moreover, as expected, our gaze convergence index was positively associated with dyad task performance and negatively associated with dyad cognitive load. These results suggest the utility of (theoretical or practical) applications such as synchronized gaze convergence displays in diverse settings. Further research perspectives, particularly into the construct’s nomological network, are warranted.

show abstract

Look at you, look at me: Detection and analysis of mutual gaze convergence in face-to-face interaction

Cited by 5 publications

References 9 publications

Prior Knowledge Facilitates Mutual Gaze Convergence and Head Nodding Synchrony in Face-to-face Communication

Prior Knowledge Facilitates Mutual Gaze Convergence and Head Nodding Synchrony in Face-to-face Communication

An Automated Mutual Gaze Detection Framework for Social Behavior Assessment in Therapy for Children with Autism

Collaborative Use of a Shared System Interface: The Role of User Gaze—Gaze Convergence Index Based on Synchronous Dual-Eyetracking

Contact Info

Product

Resources

About