Technology-Assisted Emotion Recognition for Autism Spectrum Disorder (ASD) Children: A Systematic Literature Review

Rashidan, M.A.; Sidek, Shahrul Na’im; Yusof, Hazlina Md; Khalid, Madihah; Dzulkarnain, Ahmad Aidil Arafat; Ghazali, Aimi Shazwani; Zabidi, Sarah Afiqah Mohd; Sidique, Faizanah Abdul Alim

doi:10.1109/access.2021.3060753

Cited by 17 publications

(17 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, the other systematic review study reports the following as future works: widen the age range (in two studies), varied demographics (four), larger sample size (four), prior ASD clinical test (one), repeat to the same age group (one) [9].…”

Section: Participantsmentioning

confidence: 99%

“…Regarding the setup-based ones, authors report the limitations of using a camera placed in a robot eye-a robotic turning head as a part of the scenario or robot hair that occluded the scene in some recordings were reported [35]. Another study reported possible future works as: all-day recordings, fixed subject distance, and the limitation of subject movements [9]. While one might optimize the emotion setup to get as accurate a recording of emotional symptoms as possible, some of the obstacles are inevitable.…”

Section: Modalities and Their Processing In Autismmentioning

confidence: 99%

“…There are three studies (literature reviews) that we follow in our study [7][8][9]. In the study by Kowallik A. E. and Schweinberger S. R. [7], the authors review papers related to sensor-based social information processing.…”

Section: Introductionmentioning

confidence: 99%

“…They refer to the perception of emotions by children with autism rather than to the recognition of the emotions of the children. The study by Rashidan et al [9] focuses on emotion recognition applied on children with autism. The study raises research questions regarding the stimuli used and the method of feature extraction, and might be considered as complementary to ours.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

Landowska

Karpus

Zawadzka

et al. 2022

Sensors

View full text Add to dashboard Cite

The automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities are used in the analyzed studies, including facial expressions, prosody of speech, and physiological signals. Regarding representation models, the basic emotions are the most frequently recognized, especially happiness, fear, and sadness. Both single-channel and multichannel approaches are applied, with a preference for the first one. For multimodal recognition, early fusion was the most frequently applied. SVM and neural networks were the most popular for building classifiers. Qualitative analysis revealed important clues on participant group construction and the most common combinations of modalities and methods. All channels are reported to be prone to some disturbance, and as a result, information on a specific symptoms of emotions might be temporarily or permanently unavailable. The challenges of proper stimuli, labelling methods, and the creation of open datasets were also identified.

show abstract

Section: Participantsmentioning

confidence: 99%

Section: Modalities and Their Processing In Autismmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

Landowska

Karpus

Zawadzka

et al. 2022

Sensors

View full text Add to dashboard Cite

show abstract

“…However, many researchers have shown that children with ASD have certain disorders in the processing of facial expressions. They have difficulty in accurately recognizing facial expressions and responding appropriately [ 8 ]. This is regarded as one of the important or even core causes of their social disorders [ 9 ].…”

Section: Introductionmentioning

confidence: 99%

Eye Tracking Research on the Influence of Spatial Frequency and Inversion Effect on Facial Expression Processing in Children with Autism Spectrum Disorder

et al. 2022

View full text Add to dashboard Cite

Facial expression processing mainly depends on whether the facial features related to expressions can be fully acquired, and whether the appropriate processing strategies can be adopted according to different conditions. Children with autism spectrum disorder (ASD) have difficulty accurately recognizing facial expressions and responding appropriately, which is regarded as an important cause of their social disorders. This study used eye tracking technology to explore the internal processing mechanism of facial expressions in children with ASD under the influence of spatial frequency and inversion effects for improving their social disorders. The facial expression recognition rate and eye tracking characteristics of children with ASD and typical developing (TD) children on the facial area of interest were recorded and analyzed. The multi-factor mixed experiment results showed that the facial expression recognition rate of children with ASD under various conditions was significantly lower than that of TD children. TD children had more visual attention to the eyes area. However, children with ASD preferred the features of the mouth area, and lacked visual attention and processing of the eyes area. When the face was inverted, TD children had the inversion effect under all three spatial frequency conditions, which was manifested as a significant decrease in expression recognition rate. However, children with ASD only had the inversion effect under the LSF condition, indicating that they mainly used a featural processing method and had the capacity of configural processing under the LSF condition. The eye tracking results showed that when the face was inverted or facial feature information was weakened, both children with ASD and TD children would adjust their facial expression processing strategies accordingly, to increase the visual attention and information processing of their preferred areas. The fixation counts and fixation duration of TD children on the eyes area increased significantly, while the fixation duration of children with ASD on the mouth area increased significantly. The results of this study provided theoretical and practical support for facial expression intervention in children with ASD.

show abstract

The Influence of Internet+ and AI on Social Work

Zhang

Ze-chun

Yan

et al. 2022

Application of Intelligent Systems in Multi-Modal Information Analytics

View full text Add to dashboard Cite

Technology-Assisted Emotion Recognition for Autism Spectrum Disorder (ASD) Children: A Systematic Literature Review

Cited by 17 publications

References 47 publications

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

Eye Tracking Research on the Influence of Spatial Frequency and Inversion Effect on Facial Expression Processing in Children with Autism Spectrum Disorder

The Influence of Internet+ and AI on Social Work

Contact Info

Product

Resources

About