The Use of Virtual Characters to Assess and Train Non-Verbal Communication in High-Functioning Autism

Abstract

High-functioning autism (HFA) is a neurodevelopmental disorder, which is characterized by life-long socio-communicative impairments on the one hand and preserved verbal and general learning and memory abilities on the other. One of the areas where particular difficulties are observable is the understanding of non-verbal communication cues. Thus, investigating the underlying psychological processes and neural mechanisms of non-verbal communication in HFA allows a better understanding of this disorder, and potentially enables the development of more efficient forms of psychotherapy and trainings. However, the research on non-verbal information processing in HFA faces several methodological challenges. The use of virtual characters (VCs) helps to overcome such challenges by enabling an ecologically valid experience of social presence, and by providing an experimental platform that can be systematically and fully controlled. To make this field of research accessible to a broader audience, we elaborate in the first part of the review the validity of using VCs in non-verbal behavior research on HFA, and we review current relevant paradigms and findings from social-cognitive neuroscience. In the second part, we argue for the use of VCs as either agents or avatars in the context of “transformed social interactions.” This allows for the implementation of real-time social interaction in virtual experimental settings, which represents a more sensitive measure of socio-communicative impairments in HFA. Finally, we argue that VCs and environments are a valuable assistive, educational and therapeutic tool for HFA.

Virtual worlds for people with autism spectrum disorder: a case study in Second Life

“…Some people with ASD appear to have little interest in social interaction whereas others may have the interest, but do not know how to relate to others [24,25]. People with ASD are often unable to interpret nonverbal communication, such as body language or facial expressions [2,23,24].…”

“…Many people with ASD have exceptional abilities in visual, music, and academic skills, and about 40% have average to above average intellectual abilities [22]. Nevertheless, people with ASD may experience difficulties with motor coordination, attention, and physical health issues [23], along with difficulties with social skills and communication [24]. They may also find it difficult to initiate and maintain a conversation [2].…”

Emotion recognition in autism spectrum disorder

“…Tartaro and Cassell [2008] suggested that collaborative narratives with virtual peers may offer a structured setting for using contingent discourse. Georgescu et al [2014] reviewed previous research done with virtual characters and virtual reality environments (VRE). They concluded that these provide great value for experimental paradigms in social cognition, specifically those related with non-verbal behavior and perception in participants with high-functioning autism, because it allows to grasp the full extent of the social world in a controlled manner.…”

New Frontiers in Healthcare and Technology: Internet-and Web-Based Mental Options Emerge to Complement In-Person and Telepsychiatric Care Options

“…A prototype Internet-based VR apps was Second Life (http:// secondlife.com/) [114]. Virtual characters and environments represent a valuable tool for the supportive therapies and the training of social skills and non-verbal decoding (e.g., high-functioning autism), as they provide a safe, repeatable and diversifiable learning environment [115]. There are few problems, though as when participating in violent games, avatars personalize risk by simulating harm to digital representations with which people directly identify, and this may be upsetting [116] Another type of a VR platform is a fully immersive system.…”