Classification of facial paralysis based on machine learning techniques

Abstract

Facial paralysis (FP) is an inability to move facial muscles voluntarily, affecting daily activities. There is a need for quantitative assessment and severity level classification of FP to evaluate the condition. None of the available tools are widely accepted. A comprehensive FP evaluation system has been developed by the authors. The system extracts real-time facial animation units (FAUs) using the Kinect V2 sensor and includes both FP assessment and classification. This paper describes the development and testing of the FP classification phase. A dataset of 375 records from 13 unilateral FP patients and 1650 records from 50 control subjects was compiled. Artificial Intelligence and Machine Learning methods are used to classify seven FP categories: the normal case and three severity levels: mild, moderate, and severe for the left and right sides. For better prediction results (Accuracy = 96.8%, Sensitivity = 88.9% and Specificity = 99%), an ensemble learning classifier was developed rather than one weak classifier. The ensemble approach based on SVMs was proposed for the high-dimensional data to gather the advantages of stacking and bagging. To address the problem of an imbalanced dataset, a hybrid strategy combining three separate techniques was used. Model robustness and stability was evaluated using fivefold cross-validation. The results showed that the classifier is robust, stable and performs well for different train and test samples. The study demonstrates that FAUs acquired by the Kinect sensor can be used in classifying FP. The developed FP assessment and classification system provides a detailed quantitative report and has significant advantages over existing grading scales.

DeepSmile: Anomaly Detection Software for Facial Movement Assessment

“…In short, we have addressed a facial movement assessment problem as a non-linear optimization task rather than a classification task [57] to avoid a certain level of subjectivity, ex. the classes being defined by the grades of the House-Brackmann system.…”

Automatic Facial Palsy Detection—From Mathematical Modeling to Deep Learning

“…The authors extracted a number of feature points that enabled the segmentation of faces in local regions, enabling specific asymmetry evaluation for regions of interest rather than the entire face. Gaber et al [68] proposed an evaluation system for seven palsy categories based on an ensemble learning SVM classifier, reporting an accuracy of 96.8%. The authors proved that their proposed classifier was robust and stable, even for different training and testing samples.…”

Intelligent bell facial paralysis assessment: a facial recognition model using improved SSD network

“…Leveraging deep learning algorithms and computer vision techniques, automated detection and analysis of facial expressions, ocular muscles, and lip muscles become feasible, thereby enabling quantitative evaluation of the patient’s facial functionality and tracking of condition alterations. This provision of crucial reference information empowers physicians and acupuncturists to craft and fine-tune treatment plans with precision 7 . Furthermore, artificial intelligence can be harnessed for the development of therapeutic assistance systems tailored to facial palsy.…”