Drug-induced parkinsonism affects many older adults with dementia, often causing gait disturbances. New advances in vision-based human poseestimation have opened possibilities for frequent and unobtrusive analysis of gait in residential settings. This work proposes novel spatial-temporal graph convolutional network (ST-GCN) architectures and training procedures to predict clinical scores of parkinsonism in gait from video of individuals with dementia. We propose a two-stage training approach consisting of a self-supervised pretraining stage that encourages the ST-GCN model to learn about gait patterns before predicting clinical scores in the finetuning stage. The proposed ST-GCN models are evaluated on joint trajectories extracted from video and are compared against traditional (ordinal, linear, random forest) regression models and temporal convolutional network baselines. Three 2D human pose-estimation libraries (OpenPose, Detectron, AlphaPose) and the Microsoft Kinect (2D and 3D) are used to extract joint trajectories of 4787 natural walking bouts from 53 older adults with dementia. A subset of 399 walks from 14 participants is annotated with scores of parkinsonism severity on the gait criteria of the Unified Parkinson's Disease Rating Scale (UPDRS) and the Simpson-Angus Scale (SAS). Our results demonstrate that ST-GCN models operating on 3D joint trajectories extracted from the Kinect consistently outperform all other models and feature sets. Prediction of parkinsonism scores in natural walking bouts of unseen participants remains a challenging task, with the best models achieving macroaveraged F1-scores of 0.53 ± 0.03 and 0.40 ± 0.02 for UPDRS-gait and SAS-gait, respectively. Pre-trained model and demo code for this work is available: https://github.com/TaatiTeam/stgcn_parkinsonism_predict ion.
Background: Parkinsonism is common in people with dementia, and is associated with neurodegenerative and vascular changes in the brain, or with exposure to antipsychotic or other dopamine antagonist medications. The detection of parkinsonian changes to gait may provide an opportunity to intervene and address reversible causes. In this study, we investigate the use of a vision-based system as an unobtrusive means to assess severity of parkinsonism in gait. Methods: Videos of walking bouts of natural gait were collected in a specialized dementia unit using a Microsoft Kinect sensor and onboard color camera, and were processed to extract sixteen 3D and eight 2D gait features. Univariate regression to gait quality, as rated on the Unified Parkinson's Disease Rating Scale (UPDRS) and Simpson-Angus Scale (SAS), was used to identify gait features significantly correlated to these clinical scores for inclusion in multivariate models. Multivariate ordinal logistic regression was subsequently performed and the relative contribution of each gait feature for regression to UPDRS-gait and SAS-gait scores was assessed. Results: Four hundred one walking bouts from 14 older adults with dementia were included in the analysis. Multivariate ordinal logistic regression models incorporating selected 2D or 3D gait features attained similar accuracies: the UPDRS-gait regression models achieved accuracies of 61.4 and 62.1% for 2D and 3D features, respectively. Similarly, the SAS-gait models achieved accuracies of 47.4 and 48.5% with 2D or 3D gait features, respectively. Conclusions: Gait features extracted from both 2D and 3D videos are correlated to UPDRS-gait and SAS-gait scores of parkinsonism severity in gait. Vision-based systems have the potential to be used as tools for longitudinal monitoring of parkinsonism in residential settings.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.