Evaluation of the Reproducibility of Nonverbal Facial Expressions Using a 3D Motion Capture System

Ju, Xiangyang; O'Leary, Emer; Peng, Matthew Jian-Qiao; Al-Anezi, Thamer; Ayoub, Ashraf; Khambay, Balvinder

doi:10.1597/14-090r

Cited by 13 publications

(13 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These studies evaluated the repeatability of maximum motion state of expressions but did not consider that facial expression is a dynamic motion process. Another study evaluated expression reproducibility by comparing differences of the amplitude, speed, and similarity of the trajectory of the same facial landmark between repeated recordings (Ju et al, 2016). That research reflected the dynamic characteristics of facial expressions; however, the use of landmarks to analyze facial expressions still has its limitation: The characteristic landmarks mostly are distributed in the eyes, nose, and lips, while other positions such as the forehead and cheek could be overlooked.…”

Section: Discussionmentioning

confidence: 99%

“…However, the use of 3-D static images ignored the dynamic characteristics of facial expressions. Ju et al (2016) selected special landmarks on the face and utilized a 3-D Motion Capture System to record the dynamic process of nonverbal facial expression. The similarity of the movement trajectories of facial landmarks represented the repeatability of facial expressions.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Three-Dimensional Dynamic Analysis of the Reproducibility of Verbal and Nonverbal Facial Expressions

Qiu

Xue

et al. 2021

The Cleft Palate-Craniofacial Journal

View full text Add to dashboard Cite

Objective: The aim of this study is to compare the short- and long-term reproducibility of verbal and nonverbal facial expressions of normal people using dynamic 3-dimensional (3-D) imaging. Design: Prospective, cross-sectional, controlled study. Setting: Peking University School and Hospital of Stomatology, Beijing, China. Patients and Participants: Twenty-seven participants, 12 males and 15 females, were recruited for this study. Methods: A 3-D dynamic system was applied to capture the process of 4 nonverbal facial expressions (smile lips closed, smile lips open, lip purse, cheek puff) and 2 verbal facial expressions (/i:/, /u:/) at an initial time point, 15 minutes later, and 1 week later. Key frames were selected from each expression recording sequence. Main Outcome Measures: The root mean square (RMS) between each key frame and its corresponding frame at rest was calculated. ΔRMS reflected the difference of the same key frames between the different sessions of the same expression of the same participant. The reproducibility of different facial expressions at different time intervals were analyzed. Results: There was no significant difference in verbal and nonverbal expression repeatability during a 15-minute interval, except for cheek puff motion. Following a 1-week interval, verbal expression repeatability was superior to that of nonverbal expressions ( P < .01). Compared with nonverbal expressions, the repeatability of verbal expressions did not obviously decrease with the increase in recording interval. Conclusions: Dynamic 3-D imaging is a useful technique for facial expression analysis. Verbal expressions showed greater reproducibility than nonverbal expressions.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Three-Dimensional Dynamic Analysis of the Reproducibility of Verbal and Nonverbal Facial Expressions

Qiu

Xue

et al. 2021

The Cleft Palate-Craniofacial Journal

View full text Add to dashboard Cite

show abstract

“…Our findings suggest a stark difference in the reproducibility of facial expressions between healthy individuals and those suffer from unilateral facial paralysis. It has been shown that maximum smile is one of the reproducible facial expressions in those who do not suffer from facial paralysis (29) .…”

Section: Discussionmentioning

confidence: 99%

Reproducibility of the dynamics of facial expressions in unilateral facial palsy

Alagha

Morley

et al. 2018

International Journal of Oral and Maxillofacial Surgery

View full text Add to dashboard Cite

Abstract:The aim of this study was to assess the reproducibility of non-verbal facial expressions in unilateral facial paralysis using the dynamic 4D imaging. Di4D system was utilized to record 5 facial expressions of 20-adult patients. The system captured 60 3D images/second; each facial expression took 3-4 seconds to record which generated a set of 180 3D facial images for each expression. The procedure was repeated after 30 minutes to assess the reproducibility of the expressions. A mathematical facial mesh which consists of thousand of quasi points "vertices" was conformed to the face to disclose the morphological characteristics in a comprehensive manner. The vertices of the conformed mesh were tracked throughout the sequence of the 180 3D images. Five key 3D facial frames of each sequence of images were analyzed.. We compared the 3D facial morphology at each of the five key frames of the first and the second capture of each facial expression to assess the reproducibility of the facial movements. The corresponding images were aligned using partial Procrustes analysis, the root square mean of the distances between these was calculated and statistically analyzed using paired student t-test at P=0.05. Facial expressions of lip purse, cheek puff and raising of the eyebrows were reproducible. The facial expressions of maximum smile and forceful eye closure were not reproducible. The limited coordination of various groups of facial muscles contributed to the lack of reproducibility of these facial expressions. The 4D imagining is a useful clinical tool for the assessment of facial expressions.Introduction:

show abstract

“…Soft-tissue facial movements can be noninvasively captured and quantified by 3D motion analyzers 5,14,22,23,[25][26][27][28][29] . Among others, optoelectronic motion systems offer a valuable support for extracting objective measurements by positioning markers in standardized anatomical points 23,[27][28][29][30][31] . 4 The aim of this longitudinal study is to analyze the pre-surgery versus post-surgery differences in verbal and nonverbal soft-tissue facial movements in a group of patients with dentoskeletal Class III, candidates to bimaxillary orthognathic surgery.…”

Section: Introductionmentioning

confidence: 99%

Three-dimensional longitudinal evaluation of facial mimicry in orthognathic class III surgery

Cullati

Rusconi

Mapelli

et al. 2019

International Journal of Oral and Maxillofacial Surgery

View full text Add to dashboard Cite

Order of Authors: federico cullati; francesca m rusconi; andrea mapelli; matteo zago; giada a beltramini; aldo b gianni'; chiarella sforza, MD, PhD Manuscript Region of Origin: ITALY Abstract: The effect of bimaxillary orthognathic surgery on facial mimicry was longitudinally assessed in 15 patients with dentoskeletal Class III facial dysmorphosis (7 men, 8 women, mean age 28 years). The patients were analyzed pre-surgery and 6, 12 and 24 months post-surgery while performing verbal (five vowels) and nonverbal (open and closed mouth smile, lip purse) soft-tissue facial movements. The 3D motions of right and left naso-genian, crista philtri, cheilion and lower lip landmarks were detected by an optoelectronic instrument, and a total mobility index was obtained. Side differences were quantified by an index of symmetry. Patients values were compared to those previously collected in healthy volunteers by computing z-scores. On average, 24 months after surgery no significant differences were found in the mobility of the buccal soft tissues (ANOVA p values range 0.075-0.808), with positive median z-scores (pooled mean value close to 0.6). Symmetry indices ranged around the control reference values, showing no stage-related differences (Friedman test p values range 0.252-0.937), and exceeding 90% for all movements 24 months after surgery. Bimaxillary osteotomy does not compromize facial mimicry, in both verbal and nonverbal facial movements. , which I would like to submit as Research Paper for the publication in the International Journal of Oral and Maxillofacial Surgery.In the paper, we investigated the modifications in facial mimicry after orthognathic surgery using a motion capture instrument. The method of data collection had already been published by the Journal (Facial mimicry after conservative parotidectomy: A three-dimensional optoelectronic study. Int J Oral Maxillofac Surg. 2012;41:986-93; The effect of age and sex on facial mimicry: a threedimensional study in healthy adults. Int J Oral Maxillofac Surg. 2010;39:990-9).

show abstract

Evaluation of the Reproducibility of Nonverbal Facial Expressions Using a 3D Motion Capture System

Abstract: There were no differences in magnitude and speed for maximal smile, cheek puff, and lip purse between the two captures for all participants. For individual expressions, maximal smile expression had the highest similarity value for individual landmarks.

Cited by 13 publications

References 39 publications

Three-Dimensional Dynamic Analysis of the Reproducibility of Verbal and Nonverbal Facial Expressions

Three-Dimensional Dynamic Analysis of the Reproducibility of Verbal and Nonverbal Facial Expressions

Reproducibility of the dynamics of facial expressions in unilateral facial palsy

Three-dimensional longitudinal evaluation of facial mimicry in orthognathic class III surgery

Contact Info

Product

Resources

About