3D Video Tracking Technology in the Assessment of Orofacial Impairments in Neurological Disease: Clinical Validation

Abstract

Purpose: This study sought to determine whether clinically interpretable kinematic features extracted automatically from three-dimensional (3D) videos were correlated with corresponding perceptual clinical orofacial ratings in individuals with orofacial impairments due to neurological disorders. Method: 45 participants (19 diagnosed with motor neuron diseases [MNDs] and 26 poststroke) performed two nonspeech tasks (mouth opening and lip spreading) and one speech task (repetition of a sentence “Buy Bobby a Puppy”) while being video-recorded in a standardized lab setting. The color video recordings of participants were assessed by an expert clinician—a speech language pathologist—on the severity of three orofacial measures: symmetry, range of motion (ROM), and speed. Clinically interpretable 3D kinematic features, linked to symmetry, ROM, and speed, were automatically extracted from video recordings, using a deep facial landmark detection and tracking algorithm for each of the three tasks. Spearman correlations were used to identify features that were significantly correlated ( p value < .05) with their corresponding clinical scores. Clinically significant kinematic features were then used in the subsequent multivariate regression models to predict the overall orofacial impairment severity score. Results: Several kinematic features extracted from 3D video recordings were associated with their corresponding perceptual clinical scores, indicating clinical validity of these automatically derived measures. Different patterns of significant features were observed between MND and poststroke groups; these differences were aligned with clinical expectations in both cases. Conclusions: The results show that kinematic features extracted automatically from simple clinical tasks can capture characteristics used by clinicians during assessments. These findings support the clinical validity of video-based automatic extraction of kinematic features.

A multimodal approach to automated hierarchical assessment of bulbar involvement in amyotrophic lateral sclerosis

“…From the kinematic modality, both pointwise and trajectory-based measures have been derived to characterize the positioning, movement, and coordination of orofacial structures (e.g., tongue, jaw, lips). These measures, including range of motion, displacement, speed/velocity, acceleration, jerk, cumulative path, area, asymmetry, variability, and spatiotemporal coupling, provide targeted assessment of reduced, slowed, jerky, asymmetrical, irregular, and dyscoordinated orofacial motion, as well documented in the motor speech disorders literature (11,24,25,30,(34)(35)(36)(37)(38)(39)(40)(41)(42). Such speech-based acoustic and kinematic measures have shown promise for detecting clinically indiscernible subclinical bulbar involvement in ALS.…”