A Pilot Study on Facial Expression Recognition Ability of Autistic Children Using Ryan, A Rear-Projected Humanoid Robot

Askari, Farzaneh; Feng, Haunghao; Sweeny, Timothy D.; Mahoor, Mohammad H.

doi:10.1109/roman.2018.8525825

Cited by 10 publications

(8 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[ [ [97][98][99] Since the therapist's availability is limited, SARs must be developed with a certain level of autonomy in order to carry out the treatments. This autonomy is directly correlated with a SAR's level of intelligence in adapting to the environment and the patient's responses.…”

Section: Appearance Type Description Publicationsmentioning

confidence: 99%

Socially Assistive Robots for Older Adults and People with Autism: An Overview

2020

View full text Add to dashboard Cite

Over one billion people in the world suffer from some form of disability. Nevertheless, according to the World Health Organization, people with disabilities are particularly vulnerable to deficiencies in services, such as health care, rehabilitation, support, and assistance. In this sense, recent technological developments can mitigate these deficiencies, offering less-expensive assistive systems to meet users’ needs. This paper reviews and summarizes the research efforts toward the development of these kinds of systems, focusing on two social groups: older adults and children with autism.

show abstract

Section: Appearance Type Description Publicationsmentioning

confidence: 99%

Socially Assistive Robots for Older Adults and People with Autism: An Overview

2020

View full text Add to dashboard Cite

show abstract

“…Other researchers have begun to use robots to conduct music-based therapy sessions. In such studies, children with autism are asked to imitate music based on the Wizard of Oz and Applied Behavior Analysis (ABA) models using humanoid robots in interventional sessions to practice eye-gaze and joint attention skills Askari et al (2018) ; Taheri et al (2015 , 2016) .…”

Section: Related Workmentioning

confidence: 99%

A Music-Therapy Robotic Platform for Children With Autism: A Pilot Study

2022

View full text Add to dashboard Cite

Children with Autism Spectrum Disorder (ASD) experience deficits in verbal and nonverbal communication skills including motor control, turn-taking, and emotion recognition. Innovative technology, such as socially assistive robots, has shown to be a viable method for Autism therapy. This paper presents a novel robot-based music-therapy platform for modeling and improving the social responses and behaviors of children with ASD. Our autonomous social interactive system consists of three modules. Module one provides an autonomous initiative positioning system for the robot, NAO, to properly localize and play the instrument (Xylophone) using the robot’s arms. Module two allows NAO to play customized songs composed by individuals. Module three provides a real-life music therapy experience to the users. We adopted Short-time Fourier Transform and Levenshtein distance to fulfill the design requirements: 1) “music detection” and 2) “smart scoring and feedback”, which allows NAO to understand music and provide additional practice and oral feedback to the users as applicable. We designed and implemented six Human-Robot-Interaction (HRI) sessions including four intervention sessions. Nine children with ASD and seven Typically Developing participated in a total of fifty HRI experimental sessions. Using our platform, we collected and analyzed data on social behavioral changes and emotion recognition using Electrodermal Activity (EDA) signals. The results of our experiments demonstrate most of the participants were able to complete motor control tasks with 70% accuracy. Six out of the nine ASD participants showed stable turn-taking behavior when playing music. The results of automated emotion classification using Support Vector Machines illustrates that emotional arousal in the ASD group can be detected and well recognized via EDA bio-signals. In summary, the results of our data analyses, including emotion classification using EDA signals, indicate that the proposed robot-music based therapy platform is an attractive and promising assistive tool to facilitate the improvement of fine motor control and turn-taking skills in children with ASD.

show abstract

Section: Related Workmentioning

confidence: 99%

A Music-Therapy Robotic Platform for Children with Autism: A Pilot Study

Fengr¹,

Mahoor²,

Dino³

2022

Preprint

View full text Add to dashboard Cite

Children with Autism Spectrum Disorder (ASD) experience deficits in verbal and nonverbal communication skills including motor control, turn-taking, and emotion recognition. Innovative technology, such as socially assistive robots, has shown to be a viable method for Autism therapy. This paper presents a novel robot-based music-therapy platform for modeling and improving the social responses and behaviors of children with ASD. Our autonomous social interactive system consists of three modules. Module 1 provides an autonomous initiative positioning system for the robot, NAO, to properly localize and play the instrument (Xylophone) using the robot's arms. Module 2 allows NAO to play customized songs composed by individuals. Module 3 provides a real-life music therapy experience to the users. We adopted Short-time Fourier Transform and Levenshtein distance to fulfill the design requirements: a) "music detection" and b) "smart scoring and feedback", which allows NAO to understand music and provide additional practice and oral feedback to the users as applicable. We designed and implemented six Human-Robot-Interaction (HRI) sessions including four intervention sessions. Nine children with ASD and seven Typically Developing participated in a total of fifty HRI experimental sessions. Using our platform, we collected and analyzed data on social behavioral changes and emotion recognition using Electrodermal Activity (EDA) signals. The results of our experiments demonstrate most of the participants were able to complete motor control tasks with 70% accuracy. Six out of the 9 ASD participants showed stable turn-taking behavior when playing music. The results of automated emotion classification using Support Vector Machines illustrates that emotional arousal in the ASD group can be detected and well recognized via EDA bio-signals. In summary, the results of our data analyses, including emotion classification using EDA signals, indicate that the proposed robot-music based therapy platform is an attractive and promising assistive tool to facilitate the improvement of fine motor control and turn-taking skills in children with ASD.

show abstract

A Pilot Study on Facial Expression Recognition Ability of Autistic Children Using Ryan, A Rear-Projected Humanoid Robot

Cited by 10 publications

References 19 publications

Socially Assistive Robots for Older Adults and People with Autism: An Overview

Socially Assistive Robots for Older Adults and People with Autism: An Overview

A Music-Therapy Robotic Platform for Children With Autism: A Pilot Study

A Music-Therapy Robotic Platform for Children with Autism: A Pilot Study

Contact Info

Product

Resources

About