Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review

Abstract

Affective computing, a subcategory of artificial intelligence, detects, processes, interprets, and mimics human emotions. Thanks to the continued advancement of portable non-invasive human sensor technologies, like brain–computer interfaces (BCI), emotion recognition has piqued the interest of academics from a variety of domains. Facial expressions, speech, behavior (gesture/posture), and physiological signals can all be used to identify human emotions. However, the first three may be ineffectual because people may hide their true emotions consciously or unconsciously (so-called social masking). Physiological signals can provide more accurate and objective emotion recognition. Electroencephalogram (EEG) signals respond in real time and are more sensitive to changes in affective states than peripheral neurophysiological signals. Thus, EEG signals can reveal important features of emotional states. Recently, several EEG-based BCI emotion recognition techniques have been developed. In addition, rapid advances in machine and deep learning have enabled machines or computers to understand, recognize, and analyze emotions. This study reviews emotion recognition methods that rely on multi-channel EEG signal-based BCIs and provides an overview of what has been accomplished in this area. It also provides an overview of the datasets and methods used to elicit emotional states. According to the usual emotional recognition pathway, we review various EEG feature extraction, feature selection/reduction, machine learning methods (e.g., k-nearest neighbor), support vector machine, decision tree, artificial neural network, random forest, and naive Bayes) and deep learning methods (e.g., convolutional and recurrent neural networks with long short term memory). In addition, EEG rhythms that are strongly linked to emotions as well as the relationship between distinct brain areas and emotions are discussed. We also discuss several human emotion recognition studies, published between 2015 and 2021, that use EEG data and compare different machine and deep learning algorithms. Finally, this review suggests several challenges and future research directions in the recognition and classification of human emotional states using EEG.

An Efficient Machine Learning-Based Emotional Valence Recognition Approach Towards Wearable EEG

“…Best results were achieved when the combined features were calculated from the alpha band resulting in accuracies of 96.33% and 97.42% for the kNN and SVM classifiers, respectively. Several research has shown that the frontal channels’ alpha band was significantly affected by a person’s happiness and sadness emotions [ 28 , 103 ]. The findings of this work, in which the alpha band was found to be more reliable than other frequency bands for valence recognition, are thus in agreement with previous literature.…”

A Review of AI Cloud and Edge Sensors, Methods, and Applications for the Recognition of Emotional, Affective and Physiological States

“…However, social masking—when people either consciously or unconsciously hide their true emotions—often renders the latter three ineffective. Physiological signals are therefore often a more accurate and objective gauge of emotions [ 529 ]. For instance, researchers [ 530 , 531 ] performed many studies to analyze physiological signals and unconscious emotion recognition.…”

Analisis Sentimen Menggunakan Support Vector Machine Masyarakat Indonesia Di Twitter Terkait Bjorka

“…Suatu Metode tergolong pengelompokan populer mampu menangani regresi linear dan non-linear. Support Vector Machine sering digunkan untuk membuat prediksi, seperti ramalan jangka panjang [12]. Support Vector Machine mengalami perkembangan yang sangat pesat [12], Support Vector Machine mampu menyelesaikan klasifikasi dan regresi dengan linear ataupun non-linear kernel hyperplane yang menjadikannya algoritma machine learning paling efisien untuk klasifikasi [13].…”