Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism

Lahiri, Uttama; Warren, Zachary; Sarkar, Nilanjan

doi:10.1109/tnsre.2011.2153874

Cited by 97 publications

(58 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Eye-contingent games and virtual agents are already used in clinical situations, for example for autism [19,10]. We can envision social gaze interaction being a successful candidate to further develop social therapy or cultural training and learn the consequences of one's gaze behaviour in different situations.…”

Section: Discussionmentioning

confidence: 99%

The Royal Corgi

Vidal

Bismuth

Bulling

et al. 2015

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

The eyes are a rich channel for non-verbal communication in our daily interactions. We propose social gaze interaction as a game mechanic to enhance user interactions with virtual characters. We develop a game from the ground-up in which characters are designed to be reactive to the player's gaze in social ways, such as getting annoyed when the player seems distracted or changing their dialogue depending on the player's apparent focus of attention. Results from a qualitative user study provide insights about how social gaze interaction is intuitive for users, elicits deep feelings of immersion, and highlight the players' self-consciousness of their own eye movements through their strong reactions to the characters.

show abstract

Section: Discussionmentioning

confidence: 99%

The Royal Corgi

Vidal

Bismuth

Bulling

et al. 2015

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…For example recent research, albeit using a very small sample, has suggested that virtual reality based systems can be incorporated with eye-tracking, to provide tailored feedback of gaze-sensitive data in relation to the investigation of social interaction impairments in autistic children. This virtual reality system has shown potential as a complement to more real-life social skills training (Lahiri, Warren, and Sarkar, 2011).…”

Section: Future Research and Practical Applicationsmentioning

confidence: 99%

The empathic gaze and how to find it: eye-gaze behaviour to expressions of emotion

Cowan¹

View full text Add to dashboard Cite

The quality and depth of human social interaction often depends upon the development of appropriate empathic responses. Eye contact has also been shown to play an important role in social interaction. Atypical eye contact and eye-gaze patterns exist as features of some psychological disorders such as autism, where empathic responses can be compromised and the capacity for effective social interaction hampered. In this thesis, I employed a novel eye-tracking paradigm and used dynamic emotional videos as stimuli to investigate the association between empathic response and eye-gaze within a typical population. The overarching aim was to investigate whether variation in our empathic response depends upon the gaze pattern we use to look at faces. I also investigated how eye-gaze patterns may vary across different facial expressions. For example, does sadness attract greater eye-gaze than other facial expressions, and is empathy connected to our ability to effectively use our gaze to accurately identify facial expression? Lastly, I examined how adult crying may affect eye-gaze and empathy, and by using an explicit behavioural measure I examined how pro-sociality may be affected by the observation of tearful faces. Three eye-tracking studies were conducted to investigate these emotional phenomena. Study 1 sought to establish the relationship between empathy and eye-gaze patterns to the eye region of the face and determine whether a sad expression amplifies those eye-gaze patterns compared to a neutral expression. The findings revealed a strong positive association between empathic concern and dwell-time percentage to the eye-region. In addition, a greater percentage of gaze dwell-time to the eye-region was found for a sad dynamic video than for a neutral dynamic video. Study 2 examined how gaze to the eye-region may change across varying facial expressions and to determine how gaze and empathy may relate to facial expression identification accuracy. In this study, however, no relationships between empathy, gaze and emotion identification accuracy were found. Yet, the expressions of sadness and anger attracted more gaze dwell-time to the eye-region than other emotional expressions. Study 3 investigated how empathy may be associated with the gaze patterns employed by humans when watching expressions of sadness. Moreover, it examined how the presence of tears may alter gaze in association with empathic response. A behavioural measure in the form of a charity donation task was employed to examine how expressions of sadness affect explicit prosocial behaviour. No relationship between empathy and dwell-time was found and dwell-time did not increase when participants viewed tearful faces. However, in terms of prosociality, a relationship was seen between empathy and feelings of emotional connectedness toward the person to whom most money was donated. Although the three studies produced varying results, collectively they provide support for the idea that empathy and eye-gaze are connected. Stimuli development, in terms...

show abstract

“…For example, eye-based software is already used in clinical settings for autistic patients [6] and this could further deepen the patient's understanding of gaze and its impact. We can also imagine adding a layer of immersion for players in games where the eyes play a crucial role, for example in an immersive Poker tournament in order to bluff or train oneself to not give away clues.…”

Section: Potential For Other Gamesmentioning

confidence: 99%

The Royal Corgi

Vidal

Bismuth

2014

Proceedings of the 11th Conference on Advances in Computer Entertainment Technology

View full text Add to dashboard Cite

The Royal Corgi adds social gaze to the gameplay. In this game of networking, players will need to find ways to convince characters that they are the ideal candidate to become the next Royal Corgi Instructor -but choosing dialogs wisely is not sufficient. Players have to pay attention to the way they look at characters, and find what makes them click. Do they want respect and the player's full attention? Are they sensitive to what the player seems to be interested in? This game draws players in the game with the characters and demonstrates the potential of gaze to create extremely immersive experiences.

show abstract

Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism

Cited by 97 publications

References 25 publications

The Royal Corgi

The Royal Corgi

The empathic gaze and how to find it: eye-gaze behaviour to expressions of emotion

The Royal Corgi

Contact Info

Product

Resources

About