Fused deep learning based Facial Expression Recognition of students in online learning mode

Abstract

In this research work, Facial Expression Recognition (FER) is used in the analysis of facial expressions during the online learning sessions in the prevailing pandemic situation. An integrated geometric and appearance feature extraction is presented for the FER of the students participating in the online classes. The integrated features provided a low-dimensional significant feature area for better facial data representation. Feasible Weighted Squirrel Search Optimization (FW-SSO) algorithm is applied for selecting the optimal features due to its efficient exploration of the search space and enhancement of the dynamic search. The output of the FW-SSO algorithm is used for tuning the autoencoder. Autoencoder is used for combining the G&A features, for feature optimization process. Classification is done by using Long Short-Term Memory (LSTM) network with Attention Mechanism (ALSTM), as it is highly efficient in capturing the long-term dependency of the facial landmarks in the image/video sequences.The proposed fused deep learning method focuses on the fusion of the G&A features for high discrimination. Experimental analysis using FER-2013 and LIRIS datasets demonstrated that the proposed method achieved maximum accuracy of 85.96% than the existing architectures and maximum accuracy of 88.24% than the VGGNet-CNN architecture.

An Intelligent Decision Framework For Facial Expression Recognition Based On Deep Learning

“…A frequency neural network is employed to recognize facial expression, which is based on frequency domain [9]. A fused deep learning method is proposed to fuse the G&A features for facial expression recognition, which can extract high discrimination features [10]. The above deep learning methods have made breakthrough in the field of facial expression recognition.…”

IoT Agricultural Pest Identification Based on Multiple Convolutional Models

“…VGGNet improves feature extraction by increasing the depth of the model. The number of channels per convolution layer is doubled layer by layer, allowing feature information in the image to be extracted more comprehensively [18]. The most classic and frequently used ones are VGG16 and VGG19, whose network structures are shown in Figure 2.…”