Stacking multiple cues for facial action unit detection

Akay, Simge; Arıca, Nafiz

doi:10.1007/s00371-021-02291-3

Cited by 5 publications

(1 citation statement)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To assess the effectiveness of our proposed model in comparison to the state-of-the-art methods, we evaluated our method against various existing models on the CK+, DISFA, and BP4D datasets. The models considered for comparison include Zhang [5], LibreFace [65], FS [20], STRAL [30], IDEN [81], LGR [78], MCFE [79], LUO [83], CWCF [80], JAU [82] for BP4D and DISFA datasets, and JPML [84], Simge [85], Chen1 [41], Chen2 [41], Elef [86] for the CK+ dataset.…”

Section: A Au Detection Comparison On Ck+ Disfa and Bp4d Datasetsmentioning

confidence: 99%

Attention-Enabled Lightweight Neural Network Architecture for Detection of Action Unit Activation

Deramgozin,

Jovanovic,

Arevalillo-Herráez

et al. 2023

IEEE Access

View full text Add to dashboard Cite

Facial Action Unit (AU) detection is of major importance in a broad range of artificial intelligence applications such as healthcare, Facial Expression Recognition (FER), and mental state analysis. In this paper, we present an innovative, resource-efficient facial AU detection model, embedding both spatial and channel attention mechanisms into a convolutional neural network (CNN). Along with a unique data input system leveraging image data and binary-encoded AU activation labels, our model enhances AU detection capabilities while simultaneously offering interpretability for FER systems. In contrast to existing state-of-the-art models, our proposal's streamlined architecture, combined with superior performance, establishes it as an ideal solution for resource-limited environments like mobile and embedded systems with computational constraints. The model was trained and evaluated utilizing the BP4D, CK+, DISFA, FER2013+, and RAF-DB datasets, with the latter two being particularly significant as they represent wild datasets for facial expression recognition. These datasets encompass ground truth emotions matched with corresponding AU activations according to the Facial Action Coding System. Various metrics, including F1 score, accuracy, and Euclidean distance, showcase its effectiveness in AU detection and interpretability.

show abstract