A comparative study of the 2D- and 3D-based skeleton avatar technology for assessing physical activity and functioning among healthy older adults

Abstract

Background: Maintaining physical activity (PA) and functioning (mobility, balance) is essential for older adults’ well-being and quality of life. However, current methods (functional tests, self-reports) and available techniques (accelerometers, sensors, advanced movement analysis systems) for assessing physical activity and functioning have shown to be less reliable, time- and resource-consuming with limited routine usage in clinical practice. There is a need to simplify the assessment of physical activity and functioning among older adults both in health care and clinical studies. This work presents a study on using Skeleton Avatar Technology (SAT) for this assessment. SAT analyzes human movement videos using artificial intelligence (AI). The study compares handy SAT based on 2D camera technology (2D SAT) with previously studied 3D SAT for assessing physical activity and functioning in older adults. Objective: To explore whether 2D SAT yields accurate results in physical activity and functioning assessment in healthy older adults, statistically compared to the accuracy of 3D SAT. Method: The mobile pose estimation model provided by Tensorflow was used to extract 2D skeletons from the video recordings of functional test movements. Deep neural networks were used to predict the outcomes of functional tests (FT), expert-based movement quality assessment (EA), accelerometer-based assessments (AC), and self-assessments of PA (SA). To compare the accuracy with 3D SAT models, statistical analysis was used to test whether the difference in the predictions between 2D and 3D models is significant or not. Results: Overall, the accuracy of 2D SAT is lower than 3D SAT in predicting FTs and EA. 2D SAT was able to predict AC with 7% Mean Absolute Error (MAE), and self-assessed PA (SA) with 16% MAE. On average MAE was 4% higher for 2D than for 3D SAT. There was no significant difference found between the 2D and the 3D model for AC and for two FTs (30 seconds chair stand test, 30sCST and Timed up and go, TUG). A significant difference was found for the 2D- and 3D-model of another FT (4-stage balance test, 4SBT). Conclusion: Altogether, the results show that handy 2D SAT might be used for assessing physical activity in older adults without a significant loss of accuracy compared to time-consuming standard tests and to bulky 3D SAT-based assessments. However, the accuracy of 2D SAT in assessing physical functioning should be improved. Taken together, this study shows promising results to use 2D SAT for assessing physical activity in healthy older adults in future clinical studies and clinical practice.

PAR-Net: An Enhanced Dual-Stream CNN–ESN Architecture for Human Physical Activity Recognition

“…The advantage of skeletal data over RGB data in certain situations stems from their capacity to condense intricate motions into essential joint locations and trajectories, resulting in a more distinct and less distorted depiction of human activities. The simplified representation of skeletal data allows for more efficient analysis and identification, making them a preferred method in situations where exact activity detection is essential, such as in gesture recognition [ 16 ], sports analytics [ 17 ], or healthcare applications [ 18 ] that need precise movement monitoring. While RGB data provide a wider contextual perspective, skeletal data’s concentrated representation is frequently more appropriate and resilient for the recognition and categorization of human physical activity.…”