Behavioral Biometrics in Assisted Living: A Methodology for Emotion Recognition

Abstract

Behavioral biometrics aim at providing algorithms for the automatic recognition of individual behavioral traits, stemming from a person’s actions, attitude, expressions and conduct. In the field of ambient assisted living, behavioral biometrics find an important niche. Individuals suffering from the early stages of neurodegenerative diseases (MCI, Alzheimer’s, dementia) need supervision in their daily activities. In this context, an unobtrusive system to monitor subjects and alert formal and informal carers providing information on both physical and emotional status is of great importance and positively affects multiple stakeholders. The primary aim of this paper is to describe a methodology for recognizing the emotional status of a subject using facial expressions and to identify its uses, in conjunction with pre-existing risk-assessment methodologies, for its integration into the context of a smart monitoring system for subjects suffering from neurodegenerative diseases. Paul Ekman’s research provided the background on the universality of facial expressions as indicators of underlying emotions. The methodology then makes use of computational geometry, image processing and graph theory algorithms for the detection of regions of interest and then a neural network is used for the final classification. Findings are coupled with previous published work for risk assessment and alert generation in the context of an ambient assisted living environment based on Service oriented architecture principles, aimed at remote web-based estimation of the cognitive and physical status of MCI and dementia patients.

Smart Scarf: An IOT-based Solution for Emotion Recognition

“…In our project, we focus on the relationship between changes in the heart rate and the emotional state. McCraty [13] observed a clear change in the pattern of the heart's rhythm due to the change in feelings. It was found that negative emotions such as anxiety and anger cause irregular heartbeats, while positive emotions such as sympathy and love produce high heartbeat rhythms.…”

Developing STEAM Educational Scenarios in Pedagogical Studies using Robotics: An Undergraduate Course for Elementary School Teachers

“…In their present highly technological routine, students can be truly difficult to engage, but on the other hand if the content itself, the teaching scenario is weak, then no matter how exciting or impressive technology we employ, we will fail. As more affordances are made available, the present course aims at improving its evaluation capabilities with the inclusion of affective measures such as the inclusion of cameras for adult (for students) or children emotion recognition using available algorithms [14,15] or adding Emotiv Epoc sensors for EEG evaluation of the subject's affective response during the proposed interventions each time [16]. Moreover, the inclusion of a wider theme base, integrating issues such as inclusiveness, humanitarian aid, and design of scenarios targeted to disabled people and environmental design, inside the framework of inquiry based projects, is one of our main future goals.…”

Deep Learning, Ensemble and Supervised Machine Learning for Arabic Speech Emotion Recognition

“…Emotional AI is frequently used in intelligent security, intelligent contact centers, customer assistance, medical applications, forensics, banking, and stress and anxiety treatment [8]. In [9], facial expression-based surveillance was employed to detect neurodegenerative diseases. Utilizing the LSTM model, emotions are identified from both speech and text [10].…”