Data fusion analysis for attention‐deficit hyperactivity disorder emotion recognition with thermal image and Internet of Things devices

Abstract

Summary Attention‐deficit hyperactivity disorder (ADHD) is a symptom of behavioral or emotional problems as these problems affect children's learning and social integration. With the advancements in the Internet of Things (IoTs), emotions can be detected through image and physiological data. However, some critical ADHD children are often accompanied by the inability to control their body and even facial expressions, making emotion recognition technologies difficult to develop successfully. This study aims to predict the emotions of ADHD children and to address their emotional problems with related IoT robotic devices. Data fusion analysis technology for facial expressions was used to combine thermal images and recognition data, while deep reinforcement learning technology was used to periodically stream information for ADHD students, in alignment with intervention strategies that were designed to address behavioral problems.

Robotic Technologies in ADHD Care: Literature Review

“…The advent and advancement of robotics have enabled the development of tasks that humans cannot perform, or at least not with such precision [66][67][68]. In the field of eHealth, robotics has played a fundamental role in helping and treating people with various neurological conditions such as trauma [69], dementia [33][34][35][36][37], ASD [24][25][26][27][28], cerebral palsy [29][30][31][32] and ADHD [18][19][20][21][22][23]. Although in recent years the application of robotics in the treatment and support of ADHD has received considerable research attention, however, it is far inferior compared to dementia, autism, and cerebral palsy.…”

“…The associated consequences of ADHD are behavioral and emotional problems that affect learning and social integration. The study [23] has found that emotions can be detected through processing of physiological and image data. However, some children with critical ADHD are often accompanied by the inability to control their facial expressions, making it difficult to recognize the emotion.…”

“…On the other hand, projects that use small prefabricated robots, such as LEGO robots, Asus Zenbo, and Commu [23,26,109,116], could allow changing the place of therapy. However, it has been shown that the supervision of the programmer is also required.…”

“…In recent years, non-pharmacological treatments, such as cognitive training, neurofeedback, and behavioral interventions, have gained prominence as they have been accepted by therapists as useful alternatives to avoid the use of medications in children, which in many cases can cause dependence [2,3]. Several nonpharmacological treatments to treat these NND have implemented technological developments such as the Internet of Things (IoT) [4][5][6], Artificial Intelligence (AI) [7][8][9][10], Virtual Reality (VR) [11][12][13][14], Augmented Reality (AR) [15][16][17], and Robotics [18][19][20][21][22][23].…”

Active Perception in Non-Visual Recognition Environments by Stretchable Tentacle Sensor Arrays

“…Visual recognition lays the foundation for artificial intelligence science and is crucial for various applications, including space exploration, , smart vehicles, − internet of things, − advanced manufacturing, , and others. − Visual recognition technology mainly depends on the optical information collection, as well as further process and analysis through visual processing algorithms to acquire symbolic descriptions of the scenes, thereby identifying the objects or environments. However, aimed objects might exist in light-interference or dark environments, such as smoke fogs, caves, muddy water, or other surroundings that greatly disturb the collection of optical information.…”