Recognition of dichotomous emotional states such as happy and sad play important roles in many aspects of human life. Existing literature has recorded diverse attempts in extracting physiological and non-physiological traits to record these emotional states. Selection of the right instrumental approach for measuring these traits plays a critical role in emotion recognition. Moreover, various stimuli have been used to induce emotions. Therefore, there is a current need to perform a comprehensive overview of instrumental approaches and their outcomes for the new generation of researchers. In this direction, this study surveys the instrumental approaches in discriminating happy and sad emotional states that are elicited using audio-visual stimuli. A comprehensive literature review is performed using PubMed, Scopus, and ACM digital library repositories. The reviewed articles are classified with respect to the i) stimulation modality, ii) acquisition protocol, iii) instrumentation approaches, iv) feature extraction, and v) classification methods. In total, 39 research articles were published on the selected topic of instrumental approaches in differentiating dichotomous emotional states using audio-visual stimuli between January 2011 and April 2021. The majority of the papers used physiological traits, namely electrocardiogram, electrodermal activity, heart rate variability, photoplethysmogram, and electroencephalogram based instrumental approaches for recognizing the emotional states. The results show that only a few articles have focused on audio-visual stimuli for the elicitation of happy and sad emotional states. This review is expected to seed research in the areas of standardization of protocols, enhancing the diagnostic relevance of these instruments, and extraction of more reliable biomarkers.
In this work, the feasibility of time-frequency methods, namely short-time Fourier transform, Choi Williams distribution, and smoothed pseudo-Wigner-Ville distribution in the classification of happy and sad emotional states using Electrodermal activity signals have been explored. For this, the annotated happy and sad signals are obtained from an online public database and decomposed into phasic components. The time-frequency analysis has been performed on the phasic components using three different methods. Four statistical features, namely mean, variance, kurtosis, and skewness are extracted from each method. Four classifiers, namely logistic regression, Naive Bayes, random forest, and support vector machine, have been used for the classification. The combination of the smoothed pseudo-Wigner-Ville distribution and random forest yields the highest F-measure of 68.74% for classifying happy and sad emotional states. Thus, it appears that the suggested technique could be helpful in the diagnosis of clinical conditions linked to happy and sad emotional states.
Analysis of fluctuations in electrodermal activity (EDA) signals is widely preferred for emotion recognition. In this work, an attempt has been made to determine the patterns of fluctuations in EDA signals for various emotional states using improved symbolic aggregate approximation. For this, the EDA is obtained from a publicly available online database. The EDA is decomposed into phasic components and divided into equal segments. Each segment is transformed into a piecewise aggregate approximation (PAA). These approximations are discretized using 11 time-domain features to obtain symbolic sequences. Shannon entropy is extracted from each PAA-based symbolic sequence using varied symbol size [Formula: see text] and window length [Formula: see text]. Three machine-learning algorithms, namely Naive Bayes, support vector machine and rotation forest, are used for the classification. The results show that the proposed approach is able to determine the patterns of fluctuations for various emotional states in EDA signals. PAA features, namely maximum amplitude and chaos, significantly identify the subtle fluctuations in EDA and transforms them in symbolic sequences. The optimal values of [Formula: see text] and [Formula: see text] yield the highest performance. The rotation forest is accurate (F-[Formula: see text] and 60.02% for arousal and valence dimensions) in classifying various emotional states. The proposed approach can capture the patterns of fluctuations for varied-length signals. Particularly, the support vector machine yields the highest performance for a lower length of signals. Thus, it appears that the proposed method might be utilized to analyze various emotional states in both normal and clinical settings.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.