A Survey of Micro-expression Recognition Methods Based on LBP, Optical Flow and Deep Learning

Zeng, Xiaomei; Zhao, Xingcong; Zhong, Xinyue; Liu, Guangyuan

doi:10.1007/s11063-022-11123-x

Cited by 6 publications

(1 citation statement)

References 118 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Facial expression is one of the most powerful non-verbal signals for human to convey their emotional states. Great efforts have been made on automatic facial expression recognition (FER) for its wide application in affective computing, human-computer interaction, etc [1][2][3]. Traditional FER methods [4][5][6] recognize facial expressions by extracting shallow features such as motion, grayscale, and frequency, while the performance is unacceptable.…”

Section: Introductionmentioning

confidence: 99%

Spatial-channel Capsule Aggregated Network for Robust Facial Expression Recognition

Hu,

Liu,

et al. 2024

Preprint

View full text Add to dashboard Cite

In recent years, deep learning techniques especially convolutional neural networks (CNNs), have shown significant progress in facial expression recognition. However, most prior studies are susceptible to the “fuzzy phenomena” in FER datasets, which is a common phenomenon in real-world scenarios. In addition, traditional CNNs are usually sensitive to rotations and pose variations in images, which is a common challenge in facial expression recognition because expressions can occur at different head postures. To address the above-mentioned problems, we propose a Spatial-channel Capsule Aggregated Network with Dynamic data Cleansing Module (SCAN-DCM). Specifically, we incorporate spatial and channel attention mechanism into vanilla capsule network for better capturing the relative position relationships and orientation features among the facial Action Units (AUs), enabling the model to adaptively perceive the facial AUs with high feature information density. Furthermore, the Dynamic data Cleansing Module (DCM) is proposed to address the “fuzzy phenomena” via enhancing the feature expressions of samples with high Contribution Coefficients (CC), suppressing those with low CC, and curing the wrongly labeled samples in the low CC. Extensive experiments are conducted on the FER datasets RAF-DB as well as FERPlus in natural scenes.SCAN-DCM achieves an accuracy of 82.83% on FERPlus and 86.28% on RAF-DB, which shows that our approach has remarkable performance.

show abstract