Joint Attention Simulation Using Eye-Tracking and Virtual Humans

Courgeon, Matthieu; Rautureau, Gilles; Martin, Jean‐Claude; Grynszpan, Ouriel

doi:10.1109/taffc.2014.2335740

Cited by 38 publications

(17 citation statements)

References 66 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Hence, desktop eye trackers typically integrate with head tracking based on face recognition to compensate for head movement, such as the Eye-Trac 6 desktop eye tracker from Applied Science Laboratories, which is used in [123] in their study.…”

Section: Eye Gaze Trackingmentioning

confidence: 99%

See 1 more Smart Citation

Technology-Facilitated Diagnosis and Treatment of Individuals with Autism Spectrum Disorder: An Engineering Perspective

Liu

Zhao

et al. 2017

Applied Sciences

View full text Add to dashboard Cite

Abstract:The rapid development of computer and robotic technologies in the last decade is giving hope to perform earlier and more accurate diagnoses of the Autism Spectrum Disorder (ASD), and more effective, consistent, and cost-conscious treatment. Besides the reduced cost, the main benefit of using technology to facilitate treatment is that stimuli produced during each session of the treatment can be controlled, which not only guarantees consistency across different sessions, but also makes it possible to focus on a single phenomenon, which is difficult even for a trained professional to perform, and deliver the stimuli according to the treatment plan. In this article, we provide a comprehensive review of research on recent technology-facilitated diagnosis and treat of children and adults with ASD. Different from existing reviews on this topic, which predominantly concern clinical issues, we focus on the engineering perspective of autism studies. All technology facilitated systems used for autism studies can be modeled as human machine interactive systems where one or more participants would constitute as the human component, and a computer-based or a robotic-based system would be the machine component. Based on this model, we organize our review with the following questions: (1) What are presented to the participants in the studies and how are the content and delivery methods enabled by technologies? (2) How are the reactions/inputs collected from the participants in response to the stimuli in the studies? (3) Are the experimental procedure and programs presented to participants dynamically adjustable based on the responses from the participants, and if so, how? and (4) How are the programs assessed?

show abstract

Section: Eye Gaze Trackingmentioning

confidence: 99%

“…Some studies used eye gaze information to alter the scene displayed for a participant. In [123], Courgeon et al studied the joint attention pattern using eye tracking and virtual avatars. The virtual display blurs all the scene except a small rectangular region centered on the point of gaze of the participant.…”

Section: Automatic Adaption Of Programsmentioning

confidence: 99%

Technology-Facilitated Diagnosis and Treatment of Individuals with Autism Spectrum Disorder: An Engineering Perspective

Liu

Zhao

et al. 2017

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…The avatar combined head and eye movements to simulate gaze following. The avatar's movements were designed according to the procedure described by Courgeon, Rautureau, Martin and Grynszpan[67]. The Python language was also used to animate the arrow on the screen(Figure 1), which could also be controlled via the eye-tracker.…”

mentioning

confidence: 99%

The sense of social agency in gaze leading

Recht

Grynszpan

2019

J Multimodal User Interfaces

Self Cite

View full text Add to dashboard Cite

Social interactions entail reciprocal reactions where one's communicative acts triggers responses in others. Fluent interpersonal exchange relies on the ability to discriminate behaviors produced by others that are responses to one's actions, thus involving a social sense of agency. Given the pivotal role of gaze in human communication, we propose to use gaze following as a model for studying the sense of agency in social actions. The experiment investigates the influence of sensory expertise and timing of the action's effects by comparing feedback provided by a human avatar versus a nonfigurative animated object (an arrow) and by varying the control exerted by participants' gaze on the feedback (avatar vs arrow). Results revealed a linear relationship between the judgement of agency and feedback latencies and higher agency discriminating performances with the avatar. These outcomes suggest that classical cognitive accounts of the sense of agency can be expanded to the realm of social actions and provide important information for designing virtual agents to train social gaze interactions.

show abstract

“…munication, such as the facilitating task performance, enhancing learning or enhancing the perception of the agent as being autonomous and natural ( e.g. [14,13,20]).…”

Section: The Effects Of Artificial Gazementioning

confidence: 99%

Referential Gaze Makes a Difference in Spoken Language Comprehension: Human Speaker vs. Virtual Agent Listener Gaze

Nunnemann¹,

Bergmann²,

Kreysa³

et al. 2017

The 14th International Conference on Auditory-Visual Speech Processing

View full text Add to dashboard Cite

An interlocutor's referential gaze is of great importance in faceto-face communication as it facilitates spoken language comprehension. People are also able to exploit virtual agent gaze in interactions. Our study addressed effects of human speaker gaze vs. virtual listener gaze on reaction times, accuracy and eye movements. We manipulated: (1) whether the human speaker-uttering the sentence-was visible, (2) whether the agent listener was present and (3) whether the template following each video matched the scene. Participants saw videos in which a static scene depicting three characters was visible on a screen. We recorded participants ' eye movements as they listened to German SVO sentences describing an interaction between two of these three characters. After each trial a template schematically depicting three characters and their interaction appeared on screen. Participants verified congruence between sentence and template. Participants solved the matching task very well across all conditions. They responded faster to matches than mismatches between sentence and template. Participants were slower when the agent was present. Eye movement results suggest that during the NP2 region participants tended to look at the NP2 referent to a greater extent when the speaker was present compared to the other conditions.

show abstract

Joint Attention Simulation Using Eye-Tracking and Virtual Humans

Cited by 38 publications

References 66 publications

Technology-Facilitated Diagnosis and Treatment of Individuals with Autism Spectrum Disorder: An Engineering Perspective

Technology-Facilitated Diagnosis and Treatment of Individuals with Autism Spectrum Disorder: An Engineering Perspective

The sense of social agency in gaze leading

Referential Gaze Makes a Difference in Spoken Language Comprehension: Human Speaker vs. Virtual Agent Listener Gaze

Contact Info

Product

Resources

About