Noise-Robust Deep Learning Model for Emotion Classification Using Facial Expressions

Oh, Seungjun; Kim, Dong-Keun

doi:10.1109/access.2024.3436881

IEEE Access

2024

DOI: 10.1109/access.2024.3436881

|View full text |Cite

Noise-Robust Deep Learning Model for Emotion Classification Using Facial Expressions

Seungjun Oh,

Dong-Keun Kim

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Method of Multi-Label Visual Emotion Recognition Fusing Fore-Background Features

Feng,

Wei

2024

Applied Sciences

View full text Add to dashboard Cite

This paper proposes a method for multi-label visual emotion recognition that fuses fore-background features to address the following issues that visual-based multi-label emotion recognition often overlooks: the impacts of the background that the person is placed in and the foreground, such as social interactions between different individuals on emotion recognition; the simplification of multi-label recognition tasks into multiple binary classification tasks; and it ignores the global correlations between different emotion labels. First, a fore-background-aware emotion recognition model (FB-ER) is proposed, which is a three-branch multi-feature hybrid fusion network. It efficiently extracts body features by designing a core region unit (CR-Unit) that represents background features as background keywords and extracts depth map information to model social interactions between different individuals as foreground features. These three features are fused at both the feature and decision levels. Second, a multi-label emotion recognition classifier (ML-ERC) is proposed, which captures the relationship between different emotion labels by designing a label co-occurrence probability matrix and cosine similarity matrix, and uses graph convolutional networks to learn correlations between different emotion labels to generate a classifier that considers emotion correlations. Finally, the visual features are combined with the object classifier to enable the multi-label recognition of 26 different emotions. The proposed method was evaluated on the Emotic dataset, and the results show an improvement of 0.732% in the mAP and 0.007 in the Jaccard’s coefficient compared with the state-of-the-art method.

show abstract

Method of Multi-Label Visual Emotion Recognition Fusing Fore-Background Features

Feng,

Wei

2024

Applied Sciences

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Noise-Robust Deep Learning Model for Emotion Classification Using Facial Expressions

Cited by 1 publication

References 67 publications

Method of Multi-Label Visual Emotion Recognition Fusing Fore-Background Features

Method of Multi-Label Visual Emotion Recognition Fusing Fore-Background Features

Contact Info

Product

Resources

About