“Can you help me move this over there?”: training children with ASD to joint action through tangible interaction and virtual agent

Giraud, Tatiana; Ravenet, Brian; Dang, Chi Tai; Nadel, Jacqueline; Prigent, Elise; Poli, Gaël; André, Elisabeth; Martin, Jean‐Claude

doi:10.1145/3430524.3440646

Cited by 7 publications

(7 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Of the 28 analyzed publications, 22 (79%) addressed a solution from the spectrum of AR implemented on mobile devices such as smartphones owing to their processing power and integrated sensors that make them suitable tools for implementing apps without the need for additional and sophisticated equipment. In addition, the papers by Giraud et al [ 37 ], Sait et al [ 41 ], Gulati and Handa [ 51 ], and Gelsomini et al [ 55 ] presented solutions based on VR. Although the articles by Wan et al [ 42 ] and Kalantarian et al [ 45 ] did not present an AR or VR solution, the methodology addressed and the results obtained show the potential for research in this area.…”

Section: Resultsmentioning

confidence: 99%

“…Giraud et al [ 37 ]: the study aimed to involve children with autism in common actions (moving furniture) by interacting with a virtual character projected on a tactile magnetized surface.…”

Section: Resultsmentioning

confidence: 99%

“…Giraud et al [ 37 ]: 12 children with autism spectrum disorder (ASD; including 2 girls) aged between 5 and 9 y participated in the study for a period of 3 mo. In total, 7 of the children showed little conversational language.…”

Section: Resultsmentioning

confidence: 99%

See 2 more Smart Citations

Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature Review

Toma,

Turcu,

Turcu

et al. 2024

JMIR Serious Games

View full text Add to dashboard Cite

Background The increasing prevalence of autism spectrum disorder (ASD) has driven research interest on the therapy of individuals with autism, especially children, as early diagnosis and appropriate treatment can lead to improvement in the condition. With the widespread availability of virtual reality, augmented reality (AR), and mixed reality technologies to the public and the increasing popularity of mobile devices, the interest in the use of applications and technologies to provide support for the therapy of children with autism is growing. Objective This study aims to describe the literature on the potential of virtual reality, AR, and mixed reality technologies in the context of therapy for children with ASD. We propose to investigate and analyze the temporal distribution of relevant papers, identify the target audience for studies related to extended reality apps in ASD therapy, examine the technologies used in the development of these apps, assess the skills targeted for improvement in primary studies, explore the purposes of the proposed solutions, and summarize the results obtained from their application. Methods For the systematic literature review, 6 research questions were defined in the first phase, after which 5 international databases (Web of Science, Scopus, ScienceDirect, IEEE Xplore Digital Library, and ACM Digital Library) were searched using specific search strings. Results were centralized, filtered, and processed applying eligibility criteria and using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The results were refined using a technical and IT-oriented approach. The quality criteria assessed whether the research addressed ASDs, focused on children’s therapy, involved targeted technologies, deployed solutions on mobile devices, and produced results relevant to our study. Results In the first step, 179 publications were identified in Zotero reference manager software (Corporation for Digital Scholarship). After excluding articles that did not meet the eligibility or quality assessment criteria, 28 publications were finalized. The analysis revealed an increase in publications related to apps for children with autism starting in 2015 and peaking in 2019. Most studies (22/28, 79%) focused on mobile AR solutions for Android devices, which were developed using the Unity 3D platform and the Vuforia engine. Although 68% (19/28) of these apps were tested with children, 32% (9/28) were tested exclusively by developers. More than half (15/28, 54%) of the studies used interviews as an evaluation method, yielding mostly favorable although preliminary results, indicating the need for more extensive testing. Conclusions The findings reported in the studies highlight the fact that these technologies are appropriate for the therapy of children with ASD. Several studies showed a distinct trend toward the use of AR technology as an educational tool for people with ASD. This trend entails multidisciplinary cooperation and an integrated research approach, with an emphasis on comprehensive empirical evaluations and technology ethics.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature Review

Toma,

Turcu,

Turcu

et al. 2024

JMIR Serious Games

View full text Add to dashboard Cite

show abstract

“…For example, one study conducted by affective and reactive virtual agents showed that ocular strategies in social cognition for information gathering are different whether the experimental setting is interactive or not and whether healthy aging individuals listen or answer (Pavic et al, 2021) to the question asked by virtual avatars animated by a platform named "Virtual Interactive Behaviour" (Pecune et al, 2014). Another example Giraud et al (2021) present a design of a virtual interactive system in which a virtual agent plays a mediator role for the training of children with autism spectrum disorder (ASD). The proposed system is composed of a virtual character projected onto a surface on which a tangible object is magnetized: both the user and the anthropomorphic virtual character hold the object, thus simulating a joint action.…”

Section: Virtual Agents Provide Interactionmentioning

confidence: 99%

Embodied social cognition investigated with virtual agents: The infinite loop between social brain and virtual reality

Oker

2022

Front. Virtual Real.

View full text Add to dashboard Cite

While the debate regarding the embodied nature of human cognition is still a research interest in cognitive science and epistemology, recent findings in neuroscience suggest that cognitive processes involved in social interaction are based on the simulation of others’ cognitive states and ours as well. However, until recently most research in social cognition continues to study mental processes in social interaction deliberately isolated from each other following 19th century’s scientific reductionism. Lately, it has been proposed that social cognition, being emerged in interactive situations, cannot be fully understood with experimental paradigms and stimuli which put the subjects in a passive stance towards social stimuli. Moreover, social neuroscience seems to concur with the idea that a simulation process of possible outcomes of social interaction occurs before the action can take place. In this “perspective” article, we propose that in the light of past and current research in social neuroscience regarding the implications of mirror neuron system and empathy altogether, these findings can be interpreted as a framework for embodied social cognition. We also propose that if the simulation process for the mentalization network works in ubiquity with the mirror neuron system, human experimentations for facial recognition and empathy need a new kind of stimuli. After a presentation of embodied social cognition, we will discuss the future of methodological prerequisites of social cognition studies in this area. On the matter, we will argue that the affective and reactive virtual agents are at the center in conducting such research.

show abstract

“…Visando apoiar os processos terapêuticos, foram identificadas tecnologias na literatura que usam de jogos e AVs 3D para treinamento de habilidades motoras, além da colaborac ¸ão e a comunicac ¸ão, com foco em crianc ¸as com TEA [Zhao et al 2021], [Giraud et al 2021], [Amat et al 2021]. Tarefas motoras finas na forma de jogos de computador podem proporcionar recompensas ou consequências consistentes e em tempo real para as respostas, o que pode incentivar o envolvimento e reter a atenc ¸ão das crianc ¸as [Zhao et al 2018].…”

Section: Introduc ¸ãOunclassified

Serious Game com Técnicas de Treinamento Motor Fino como Tecnologia Assistiva para encorajar a Colaboração de Crianças com TEA

Azevedo,

Gunsch,

Lacerda

et al. 2023

Anais Da XII Escola Regional De Informática De Mato Grosso (ERI-MT 2023)

View full text Add to dashboard Cite

Para crianças com Transtorno do Espectro Autista situações que exigem tanto habilidades sociais quanto motoras, como ações conjuntas, podem ser complexas, uma vez que são sensíveis aos estímulos externos, incluindo comunicação, interação, cooperação, toque físico, lugares desconhecidos, entre outros. Diante disso, há evidências na literatura, indicando que experiências vividas em Ambientes Virtuais 3D podem contribuir para a mitigação de alguns dos sintomas mencionados, encorajando a comunicação e a colaboração. A partir disso, este artigo tem como objetivo apresentar a proposta de um jogo sério 3D com técnicas treinamento motor fino a partir de técnicas identificadas na literatura. O jogo, denominado ”Dividir e Conquistar”, tem como objetivo encorajar a colaboração de crianças com Transtorno do Espectro Autista.

show abstract

“Can you help me move this over there?”: training children with ASD to joint action through tangible interaction and virtual agent

Cited by 7 publications

References 45 publications

Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature Review

Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature Review

Embodied social cognition investigated with virtual agents: The infinite loop between social brain and virtual reality

Serious Game com Técnicas de Treinamento Motor Fino como Tecnologia Assistiva para encorajar a Colaboração de Crianças com TEA

Contact Info

Product

Resources

About