Are Instructed Emotional States Suitable for Classification? Demonstration of How They Can Significantly Influence the Classification Result in An Automated Recognition System

Abstract

At the present time, various freely available or commercial solutions are used to classify the subject's emotional state. Classification of the emotional state helps us to understand how the subject feels and what he is experiencing in a particular situation. Classification of the emotional state can thus be used in various areas of our life from neuromarketing, through the automotive industry (determining how emotions affect driving), to implementing such a system into the learning process. The learning process, which is the (mutual) interaction between the teacher and the learner, is an interesting area in which individual emotional states can be explored. In this pedagogical-psychological area several research studies were realized. These studies in some cases demonstrated the important impact of the emotional state on the results of the students. However, for comparison and unambiguous classification of the emotional state most of these studies used the instructed (even constructed) stereotypical facial expressions of the most well-known test databases (Jaffe is a typical example). Such facial expressions are highly standardized, and the software can recognize them with a fairly big percentage, but this does not necessarily point to the actual success rate of the subject's emotional classification in such a test because the similarity to real emotional expression remains unknown. Therefore, we examined facial expressions in real situations. We have subsequently compared these examined facial expressions with the instructed expressions of the same emotions (the Jaffe database). The overall average classification score in real facial expressions was 94.58%.

Internet and Biometric Web Based Business Management Decision Support

“…Anger, disgust, fear, happiness, sadness, surprise and neutral Facial expression recognition [355] Destination promotional videos Pleasure, arousal Skin conductance, facial electromyography [355] Games scenario between a human user and a 3D humanoid agent Arousal, valence, fear, frustrated, relaxed, joyful, excited Electromyography, skin conductance [356] Dramatic film Real-time emotion estimation EEG, Heart Rate, Galvanic Skin Response [357] Emotional state of a driver while in an automobile Happy, anger Electrocardiogram (ECG) [358] Music Pleasure, unpleasure Heart and respiratory rates [359] Trier Social Stress Test Stress, relax Respiratory rate and heart rate [360] Voice-and speech-pattern analysis Normal, angry, panic Voice, speech [361] Implicit anxiety-related self-concept Shame, guilt proneness, anxiety, angerhostility Implicit Association Test [362] Case studies Self-control, happiness, anger, fear, sadness, surprise, and anxiety Mouse Tracking [302] Academic study website Neutral, positive, negative Mouse Tracking [363] Motor The combination of several different approaches to the recognition and classification of emotional state (also known as multimodal emotion recognition) is currently a research area of great interest, especially since the use of different physiological signals can provide huge amounts of data. Since each physiological can make a significant impact on the ability to classify emotions [333]. Table 3.3 presents an overview of studies related to the recognition of valence, arousal, emotional states, physiological states, and affective attitudes (affect).…”

Identification of heart rate change during the teaching process

“…Based on research conducted by other authors, we can state that physiological functions can be used as a tool to identify changes in emotional states, in our experiment specifically changes in degrees of arousal 46 – 51 .…”

A Review of AI Cloud and Edge Sensors, Methods, and Applications for the Recognition of Emotional, Affective and Physiological States

“…The combination of several different approaches to the recognition and classification of emotional state (also known as multimodal emotion recognition) is currently a research area of great interest, especially since the use of different physiological signals can provide huge amounts of data. Since each physiological can make a significant impact on the ability to classify emotions [ 333 ]. Table 3 presents an overview of studies related to the recognition of valence, arousal, emotional states, physiological states, and affective attitudes (affect).…”