Recognizing Emotions Evoked by Music Using CNN-LSTM Networks on EEG Signals

Abstract

Emotion is considered to be critical for the actual interpretation of actions and relationships. Recognizing emotions from EEG signals is also becoming an important computer-aided method for diagnosing emotional disorders in neurology and psychiatry. Another advantage of this approach is recognizing emotions without clinical and medical examination, which plays a major role in completing the Brain-Computer Interface (BCI) structure. Emotions recognition ability, without traditional utilization strategies such as self-assessment tests, is of paramount importance. EEG signals are considered the most reliable technique for emotions recognition because of the non-invasive nature. Manual analysis of EEG signals is impossible for emotions recognition, so an automatic method of EEG signals should be provided for emotions recognition. One problem with automatic emotions recognition is the extraction and selection of discriminative features that generally lead to high computational complexity. This paper was design to prepare a new approach to automatic two-stage classification (negative and positive) and three-stage classification (negative, positive, and neutral) of emotions from EEG signals. In the proposed method, directly apply the raw EEG signal to the convolutional neural network and long short-term memory network (CNN-LSTM), without involving feature extraction/selection. In prior literature, this is a challenging method. The suggested deep neural network architecture includes 10-convolutional layers with 3-LSTM layers followed by 2-fully connected layers. The LSTM network in a fusion of the CNN network has been used to increase stability and reduce oscillation. In the present research, we also recorded the EEG signals of 14 subjects with music stimulation for the process. The simulation results of the proposed algorithm for two-stage classification (negative and positive) and three-stage classification (negative, neutral and positive) of emotion for 12 active channels showed 97.42% and 96.78% accuracy and Kappa coefficient of 0.94 and 0.93 respectively. We also compared our proposed LSTM-CNN network (end-toend) with other hand-crafted methods based on MLP and DBM classifiers and achieved promising results in comparison with similar approaches. According to the high accuracy of the proposed method, it can be used to develop the human-computer interface system.

Developing an efficient deep neural network for automatic detection of COVID-19 using chest X-ray images

“…In general, a convolutional neural network consists of three main layers: the convolution layer, the pooling layer, and the fully connected (FC) layer which different layers perform different tasks. Details of each layer are provided below [37] , [38] : Convolution layer: using some imaging techniques such as sharpening, smoothing, noise cancellation and edge detection, the image is used as input and extracts its specific specifications. Pooling layer: reduces the dimension of the feature matrix and retains important features.…”

LPWAN and Embedded Machine Learning as Enablers for the Next Generation of Wearable Devices

“…For example, tourists will receive updated city maps or real-time information of the monuments they are visiting [ 40 ]. In turn, intelligent earables, such as headsets or earbuds, will be able to automatically select the most adequate music according to the emotional status of the user [ 41 ].…”

Recognition of EEG Signals from Imagined Vowels Using Deep Learning Methods

“…Although, DL architectures have been successfully applied to image recognition [ 43 , 44 , 45 ] and speech signal recognition [ 46 , 47 , 48 ], their use for EEG signal recognition tasks, such as imagined speech [ 49 , 50 ], remains a challenge and requires the development of novel pre-processing techniques and the development of new DL structures and architectures [ 51 , 52 ]. Among the difficulties posed by DL algorithms are: CNN methods are susceptible to the effect of artifacts present in EEG signals, generating a reduction in the accuracy of the classifiers [ 27 ].…”