A case study of gesture-based games in enhancing the fine motor skills and recognition of children with autism

Cai, Su; Zhu, Gaoxia; Wu, Ying Tien; Liu, Enrui; Hu, Xiaoyi

doi:10.1080/10494820.2018.1437048

Cited by 23 publications

(27 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Eleven studies proposed one task, three studies proposed two tasks, three studies proposed three tasks, one study proposed four tasks, and one study proposed seven tasks. Overall, the proposed tasks can be categorized as follows: matching games whose aim is to correctly associate items [ 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 ]; daily routine games whose aim is to exercise in tasks such as activities of daily living, shopping, greeting, drawing, evacuating by fire, signs recognizing, eye gazing [ 23 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 ]; collaborative games whose aim is to cooperate to complete some tasks [ 15 , 16 ]; mathematical games whose aim is to correctly perform arithmetical operations [ 48 ]; labyrinth games whose aim is to correctly reach the end of the path [ 14 ].…”

Section: Resultsmentioning

confidence: 99%

LEAP Motion Technology and Psychology: A Mini-Review on Hand Movements Sensing for Neurodevelopmental and Neurocognitive Disorders

Colombini

Duradoni

Carpi

et al. 2021

IJERPH

View full text Add to dashboard Cite

Technological advancement is constantly evolving, and it is also developing in the mental health field. Various applications, often based on virtual reality, have been implemented to carry out psychological assessments and interventions, using innovative human–machine interaction systems. In this context, the LEAP Motion sensing technology has raised interest, since it allows for more natural interactions with digital contents, via an optical tracking of hand and finger movements. Recent research has considered LEAP Motion features in virtual-reality-based systems, to meet specific needs of different clinical populations, varying in age and type of disorder. The present paper carried out a systematic mini-review of the available literature using Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines. The inclusion criteria were (i) publication date between 2013 and 2020, (ii) being an empirical study or project report, (iii) written in English or Italian languages, (iv) published in a scholarly peer-reviewed journal and/or conference proceedings, and (v) assessing LEAP Motion intervention for four specific psychological domains (i.e., autism spectrum disorder, attention-deficit/hyperactivity disorder, dementia, and mild cognitive impairment), objectively. Nineteen eligible empirical studies were included. Overall, results show that protocols for attention-deficit hyperactivity disorder and autism spectrum disorder can promote psychomotor and psychosocial rehabilitation in contexts that stimulate learning. Moreover, virtual reality and LEAP Motion seem promising for the assessment and screening of functional abilities in dementia and mild cognitive impairment. As evidence is, however, still limited, deeper investigations are needed to assess the full potential of the LEAP Motion technology, possibly extending its applications. This is relevant, considering the role that virtual reality could have in overcoming barriers to access assessment, therapies, and smart monitoring.

show abstract

Section: Resultsmentioning

confidence: 99%

LEAP Motion Technology and Psychology: A Mini-Review on Hand Movements Sensing for Neurodevelopmental and Neurocognitive Disorders

Colombini

Duradoni

Carpi

et al. 2021

IJERPH

View full text Add to dashboard Cite

show abstract

“…In their research, Garzotto, Gelsomini, Oliveto, and Valoriani (2014) also reported decreases in participant playing time from session to session among five 6-to 8-year-old children with autism playing a touchless game. Using a sample of three school children with autism, Cai et al (2018) also reported that participants became more successful in playing a game based on catching and sorting balls of different colors.…”

Section: Discussionmentioning

confidence: 98%

“…These games have addressed such ASD concerns as social interaction, emotional recognition and regulation, and cognition (Alves, Marques, Queirós, & Orvalho, 2013; Antonini et al., 2017; Aresti-Bartolome & Garcia-Zapirain, 2015; Grossard et al., 2017; Tanaka et al., 2010). There are also games for gross and fine motor skills (Cai, Zhu, Wu, Liu, & Hu, 2018). Hsu (2011) pointed out that educational games can have a significant role in the learning process and can be considered a stimulating learning tool in and out of the classroom.…”

Section: Introductionmentioning

confidence: 99%

“…Caro, Tentori, Martinez-Garcia, and Alvelais (2017) recorded positive effects in reducing aimless limb movements and developing both simple and accurate intentional limb movements of children with severe autism after seven weeks of playing FroggyBobby, a Kinect-based exercise game, designed to support eye–body coordination. Cai et al. (2018) examined the effects of playing two games for fine motor skills using leap motion and found that this intervention helped children improve fine motor skills and recognition while also learning to transfer the rules and skills they learned from the first game to completing tasks in the second game.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A Demonstration Project for the Utility of Kinect-Based Educational Games to Benefit Motor Skills of Children with ASD

et al. 2019

View full text Add to dashboard Cite

Motor disorders often accompany autism spectrum disorder (ASD), although they are not included in its diagnostic criteria. Slower motor development is evident in early childhood in this population, making early motor skills intervention advisable. As educational games and modern technology can represent new forms of treatment, this study evaluated four Kinect-based visuo-motor games called Fruits that were specially designed for this research. We sought to test whether children with ASD would show behavior changes during their game play and whether any effects would generalize to another game called Rackets. The study included 10 elementary school children with ASD, aged 9-13 years, who were divided into (a) an experimental group ( n = 5) who, in addition to standard treatment, played Fruits once a week for a 5-week period and Rackets both before and after the 5-week period and (b) a control group ( n = 5) who received only standard treatment during this period and also played Rackets before and after it. We found significant improvements in gross motor skills and successful generalization of acquired skills among children in the experimental group relative to the control group. The experimental group also showed an increase in positive emotions and a decrease in loss of attention while playing the games. These preliminary findings indicate a motor skill benefit for children with ASD who play Kinect-based educational games, but further research is needed to replicate and expand these findings with larger participant samples.

show abstract

“…Hand gesture recognition is widely researched as it can be applied to different areas such as human-computer interaction [1], robotics [2], computer games [3], education [4], automatic sign-language interpretation [5], decision support for medical diagnosis of motor skills disorders [6], recognition of children with autism [7], home-based rehabilitation [8,9], virtual training [10] and virtual surgery [11]. In industry, gesture recognition can be used in areas requiring very high precision such as to control devices such as robot hands [12] or industrial equipment.…”

Section: Introductionmentioning

confidence: 99%

Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion

et al. 2019

View full text Add to dashboard Cite

Featured Application: We describe a system that uses a Leap Motion device to recognize the gestures performed by users while immersed in a Virtual Reality (VR). The developed system can be applied for the development of the VR applications that require identification of the user's hand gestures for control of virtual objects. Abstract:We perform gesture recognition in a Virtual Reality (VR) environment using data produced by the Leap Motion device. Leap Motion generates a virtual three-dimensional (3D) hand model by recognizing and tracking user's hands. From this model, the Leap Motion application programming interface (API) provides hand and finger locations in the 3D space. We present a system that is capable of learning gestures by using the data from the Leap Motion device and the Hidden Markov classification (HMC) algorithm. We have achieved the gesture recognition accuracy (mean ± SD) is 86.1 ± 8.2% and gesture typing speed is 3.09 ± 0.53 words per minute (WPM), when recognizing the gestures of the American Sign Language (ASL).

show abstract

A case study of gesture-based games in enhancing the fine motor skills and recognition of children with autism

Cited by 23 publications

References 30 publications

LEAP Motion Technology and Psychology: A Mini-Review on Hand Movements Sensing for Neurodevelopmental and Neurocognitive Disorders

LEAP Motion Technology and Psychology: A Mini-Review on Hand Movements Sensing for Neurodevelopmental and Neurocognitive Disorders

A Demonstration Project for the Utility of Kinect-Based Educational Games to Benefit Motor Skills of Children with ASD

Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion

Contact Info

Product

Resources

About