DynGeoNet: Fusion Network for Micro-expression Spotting

Abstract

Micro-expressions (MEs) are brief and involuntary facial expressions when people hide their true feelings or conceal their emotions. Based on psychology research, MEs play an important role in understanding genuine emotions, which leads to many potential applications. However, the ME analysis system can still not work well in the real environment because of the challenging performance of ME spotting, which is to spot the images with micro-expressions from long video sequences. To improve the performance of ME spotting, we focus on hybrid feature engineering, which aims to create a robust feature for discriminating tiny movements. The proposed framework consists of two main modules: (1) the feature engineering extracts both geometric features and appearance features based on dynamic image; (2) the new deep neural network inputs the handcrafted feature for the late fusion and ME samples classification. Our experimental results from three baseline datasets demonstrate the promising results.

FESNet: Spotting Facial Expressions Using Local Spatial Discrepancy and Multi-Scale Temporal Aggregation

“…The proposed SOFTNet utilized optical flow from specific facial regions, aggregating scores to detect the apex frame. DynGeoNet [43] aimed to enhance ME spotting performance through hybrid feature engineering, extracting robust features from geometric and appearance aspects.…”

Pengenalan Ekspresi Mikro Wajah Berdasarkan Point Feature Tracking Menggunakan Fase Apex Pada Database Ekspresi Mikro

“…Berbeda dari ekspresi makro, secara studi fisiologis (Ekman, 2009) menunjukkan bahwa ekspresi mikro terjadi dalam durasi singkat dan gerakan otot yang sangat halus. Ekspresi mikro bersifat mikro (durasi pendek) dan intensitas gerakan kecil (subtle) yang berlangsung 0.04 sampai 0.2 detik dengan area pergerakan hanya di beberapa bagian wajah (Ben et al, 2021;Hashmi et al, 2021;Tran et al, 2021).…”