Engagement Estimation During Child Robot Interaction Using Deep Convolutional Networks Focusing on ASD Children

A study of children emotion and their performance while handwriting Arabic characters using a haptic device

“…However, we believe that the training session under the guided mode followed by the use of force feedback is responsible of the results (improvement in the engagement, handwriting legibility and speed) observed here and presents a possible enhancement compared to traditional methods. This assumption appears to be in line with the literature interested in the contribution of haptic devices on learning (Anagnostopoulou et al, 2021).…”

“…The study of children emotions when learning a new task is highly important as they influence their engagements and performances during the learning process. Recent studies (Anagnostopoulou et al, 2021;Baltrusaitis et al, 2016;Karumbaiah et al, 2022) attempt to improve the quality of learning techniques by continuously detecting the development and change in students' emotional experiences in order to better support individual students and maximize their engagement and learning gains (Anagnostopoulou et al, 2021). However, the task of learning to write vocabulary in any language is a challenging task especially for young children and those with low handwriting skills and moderate memory, which leads to repeated failure and may result in negative emotions.…”

“…While others, for example (Grundmann et al, 2021) monitored the emotional status of each student and provided information about student's mood to the teacher in real time when e-learning. Some studies focused mainly on features such as pen pressures as indicators of enjoyment and frustration (Anagnostopoulou et al, 2021); gaze direction (Khan, 2020), facial expression (Young-Seok Kim et al, 2013), pose estimation (Guneysu Ozgur et al, 2020) and many other techniques (Ashwin & Guddeti, 2020;Dewan et al, 2019). However, few research works have been carried out on how children with low handwriting skills react to different virtual reality environment (VR) writing tasks (Baltrusaitis et al, 2016;Savov et al, 2018;Zhao et al, 2018).…”

“…More precisely, our study focuses on the impact of a haptic device-based learning technology on students' emotions and attentiveness on their writing performance of Arabic letters. Furthermore, the continuous detection of emotion states through emotion detection models (Anagnostopoulou et al, 2021;K V & Bahel, 2021;Mukhopadhyay et al, 2020) and through eye blink detection model (Soukupová & Cech, 2016) as objective metrics, try to cope with some of the methodological problems such as self-reporting (Schrader & Kalyuga, 2020).…”

Engagement estimation of the elderly from wild multiparty human–robot interaction

“…Engagement estimation (EE) is kind of affective computing and behavior recognition, and it goes further to probe the inner intention behind the apparent behavior and emotion. Many methods have been developed to estimate engagement in various scenarios such as general HRI, 7‐10 museum tour guide, 11 classroom or distance learning, 12‐18 and healthcare 5,19‐21 . Conventional approaches use nonverbal cues such as proxemics, body pose, gaze patterns, facial expressions, and context information to build classifiers.…”