Towards Contactless Estimation of Electrodermal Activity Correlates

Bhamborae, Mayur J.; Flotho, Philipp; Mai, Adrian; Schneider, E.; Francis, Alexander L.; Strauß, Daniel J.

doi:10.1109/embc44109.2020.9176359

Cited by 7 publications

(2 citation statements)

References 14 publications

(19 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the future, some of those limitations might be overcome by contactless methods. Besides imaging and analysis of skin surface temperature in the face, preliminary studies could show that the contactless approximation of EDA signal from RGB sensors on the hand is possible in a static lab setting [51]. The multimodal camera recordings of the face collected in this study can help to investigate whether noncontact monitoring methods are able to reliably approximate the temperature and EDA dynamics in the face to realize contactless real-time evaluation of MS.…”

Section: Discussionmentioning

confidence: 89%

Electrodermal Responses to Driving Maneuvers in a Motion Sickness Inducing Real-World Driving Scenario

Schneider

Buchheit

Flotho

et al. 2022

IEEE Trans. Human-Mach. Syst.

Self Cite

View full text Add to dashboard Cite

Motion sickness is a phenomenon attracting increasing attention with the ever-growing popularity of highly automated driving. Understanding motion sickness is of significant interest in the context of self-driven vehicles because, in this case, all occupants of the vehicle are passengers and, therefore, more susceptible to motion sickness. In this article, we report the findings of a study wherein motion sickness was induced in 40% of the participants while driving in real-world conditions. By recording various psychophysiological parameters continuously (electrodermal activity, skin temperature, heart rate, and heart rate variability), we investigate the feasibility of using these to objectively assess motion sickness. Furthermore, the instantaneous physiological reactions of participants to unpleasant driving maneuvers are examined. The changes in the electrodermal activity show a strong correlation with the subjective ratings of motion sickness levels as reported by the participants. The phasic component of the electrodermal activity suggests differences between participants that are susceptible to motion sickness and those who are not. Several driving maneuvers (accelerations, cornering, and driving over speed bumps) were identified as events triggering significant electrodermal responses. These responses could be the result of a mismatch between visual and vestibular perception acting as an aversive, arousing stimulus. While, in this work, the driving maneuvers were partially overlapping and nonuniform, our results pave the way for future investigation of physiological responses to single driving events and their relation to motion sickness with the potential to identify real-time markers of possibly unpleasant driving maneuvers.

show abstract

Section: Discussionmentioning

confidence: 89%

Electrodermal Responses to Driving Maneuvers in a Motion Sickness Inducing Real-World Driving Scenario

Schneider

Buchheit

Flotho

et al. 2022

IEEE Trans. Human-Mach. Syst.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Previous research has shown that transient responses, which correlate with a person’s EDA signal, can be inferred from the periorbital, forehead, and maxillary regions of the face using thermal cameras [ 9 , 12 , 13 ]. Bhamboarae et al provided an early proof-of-concept that a person’s EDA can be inferred from the palm using an RGB camera by counting the specular reflections, which were created by specialized lighting conditions, on the palm [ 14 ]. Other research has shown that electrical stimulation and pain increase not only the sweat gland activity on the forehead but also increase the blood flow to the forehead (through sympathetic vasodilation) and the left cheek, and decreases the blood flow to the finger [ 15 , 16 ].…”

Section: Introductionmentioning

confidence: 99%

Video-based sympathetic arousal assessment via peripheral blood flow estimation

Braun,

McDuff,

Baltrusaitis

et al. 2023

Biomed. Opt. Express

View full text Add to dashboard Cite

Electrodermal activity (EDA) is considered a standard marker of sympathetic activity. However, traditional EDA measurement requires electrodes in steady contact with the skin. Can sympathetic arousal be measured using only an optical sensor, such as an RGB camera? This paper presents a novel approach to infer sympathetic arousal by measuring the peripheral blood flow on the face or hand optically. We contribute a self-recorded dataset of 21 participants, comprising synchronized videos of participants’ faces and palms and gold-standard EDA and photoplethysmography (PPG) signals. Our results show that we can measure peripheral sympathetic responses that closely correlate with the ground truth EDA. We obtain median correlations of 0.57 to 0.63 between our inferred signals and the ground truth EDA using only videos of the participants’ palms or foreheads or PPG signals from the foreheads or fingers. We also show that sympathetic arousal is best inferred from the forehead, finger, or palm.

show abstract

Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects

Khan,

Xu,

Liu

et al. 2024

Multimedia Systems

View full text Add to dashboard Cite

In recent years, emotion recognition has received significant attention, presenting a plethora of opportunities for application in diverse fields such as human–computer interaction, psychology, and neuroscience, to name a few. Although unimodal emotion recognition methods offer certain benefits, they have limited ability to encompass the full spectrum of human emotional expression. In contrast, Multimodal Emotion Recognition (MER) delivers a more holistic and detailed insight into an individual's emotional state. However, existing multimodal data collection approaches utilizing contact-based devices hinder the effective deployment of this technology. We address this issue by examining the potential of contactless data collection techniques for MER. In our tertiary review study, we highlight the unaddressed gaps in the existing body of literature on MER. Through our rigorous analysis of MER studies, we identify the modalities, specific cues, open datasets with contactless cues, and unique modality combinations. This further leads us to the formulation of a comparative schema for mapping the MER requirements of a given scenario to a specific modality combination. Subsequently, we discuss the implementation of Contactless Multimodal Emotion Recognition (CMER) systems in diverse use cases with the help of the comparative schema which serves as an evaluation blueprint. Furthermore, this paper also explores ethical and privacy considerations concerning the employment of contactless MER and proposes the key principles for addressing ethical and privacy concerns. The paper further investigates the current challenges and future prospects in the field, offering recommendations for future research and development in CMER. Our study serves as a resource for researchers and practitioners in the field of emotion recognition, as well as those intrigued by the broader outcomes of this rapidly progressing technology.

show abstract

Towards Contactless Estimation of Electrodermal Activity Correlates

Cited by 7 publications

References 14 publications

Electrodermal Responses to Driving Maneuvers in a Motion Sickness Inducing Real-World Driving Scenario

Electrodermal Responses to Driving Maneuvers in a Motion Sickness Inducing Real-World Driving Scenario

Video-based sympathetic arousal assessment via peripheral blood flow estimation

Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects

Contact Info

Product

Resources

About