Approbation of the Child's Emotional Development Method (CEDM)

Lyakso, Elena E.; Frolova, Оlga; Kleshnev, Egor; Nersisson, Ruban; Mekala, A. Mary; Arulalan, K. V.

doi:10.1145/3536220.3563371

Cited by 9 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recording of speech and facial expressions of children was carried out when testing children according to the Child's Emotional Development Method [60], which includes two blocks. Block 1 contains information about the child's development received from parents/legal representatives.…”

Section: The Audio-visual Speech Recording Proceduresmentioning

confidence: 99%

A Neural Network Architecture for Children’s Audio–Visual Emotion Recognition

Matveev,

Frolova

et al. 2023

Mathematics

Self Cite

View full text Add to dashboard Cite

Detecting and understanding emotions are critical for our daily activities. As emotion recognition (ER) systems develop, we start looking at more difficult cases than just acted adult audio–visual speech. In this work, we investigate the automatic classification of the audio–visual emotional speech of children, which presents several challenges including the lack of publicly available annotated datasets and the low performance of the state-of-the art audio–visual ER systems. In this paper, we present a new corpus of children’s audio–visual emotional speech that we collected. Then, we propose a neural network solution that improves the utilization of the temporal relationships between audio and video modalities in the cross-modal fusion for children’s audio–visual emotion recognition. We select a state-of-the-art neural network architecture as a baseline and present several modifications focused on a deeper learning of the cross-modal temporal relationships using attention. By conducting experiments with our proposed approach and the selected baseline model, we observe a relative improvement in performance by 2%. Finally, we conclude that focusing more on the cross-modal temporal relationships may be beneficial for building ER systems for child–machine communications and environments where qualified professionals work with children.

show abstract

Section: The Audio-visual Speech Recording Proceduresmentioning

confidence: 99%