EEG-based emotion recognition with deep convolutional neural networks

Abstract

The emotional state of people plays a key role in physiological and behavioral human interaction. Emotional state analysis entails many fields such as neuroscience, cognitive sciences, and biomedical engineering because the parameters of interest contain the complex neuronal activities of the brain. Electroencephalogram (EEG) signals are processed to communicate brain signals with external systems and make predictions over emotional states. This paper proposes a novel method for emotion recognition based on deep convolutional neural networks (CNNs) that are used to classify Valence, Arousal, Dominance, and Liking emotional states. Hence, a novel approach is proposed for emotion recognition with time series of multi-channel EEG signals from a Database for Emotion Analysis and Using Physiological Signals (DEAP). We propose a new approach to emotional state estimation utilizing CNN-based classification of multi-spectral topology images obtained from EEG signals. In contrast to most of the EEG-based approaches that eliminate spatial information of EEG signals, converting EEG signals into a sequence of multi-spectral topology images, temporal, spectral, and spatial information of EEG signals are preserved. The deep recurrent convolutional network is trained to learn important representations from a sequence of three-channel topographical images. We have achieved test accuracy of 90.62% for negative and positive Valence, 86.13% for high and low Arousal, 88.48% for high and low Dominance, and finally 86.23% for like–unlike. The evaluations of this method on emotion recognition problem revealed significant improvements in the classification accuracy when compared with other studies using deep neural networks (DNNs) and one-dimensional CNNs.

Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning

“…Thus, a two-step verification process is performed to evaluate the robustness of the models during the training and testing phases. Furthermore, recall (REC), precision (PRE), accuracy (ACC), specificity (SPE), F1-Score (F1-S) [ 15 ], area under the receiver operating characteristic curve (ROC-AUC) [ 64 , 78 ], and mean squared error (MSE) [ 17 ] are calculated during the validating and testing phases to investigate the robustness of the models.…”

“…Inspired by our previous study [ 64 ], we proposed a novel method to represent the paper-based ECG record as a colorful two-dimensional image for various deep learning applications. The feature mapping approach can be defined as assigning a specific value to a specific point in a two-dimensional space.…”

Arrhythmic Heartbeat Classification Using 2D Convolutional Neural Networks

“…The performance of the proposed model is evaluated utilizing various metrics which are accuracy (ACC), specificity (SPE), recall (REC), precision (PRE), and F1-Score [40]. The ACC is indicated as the total number of correctly classified ECG beat images divided by the total number of test images.…”

Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning

“…Inspired by our previous study [62], we proposed a novel method to represent the paper-based ECG record as a colorful two-dimensional image for various deep learning applications. The feature mapping approach can be defined as assigning a specific value to a specific point in a two-dimensional space.…”