Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation

Abstract

Dynamic movements of the hand, fingers, and thumb are difficult to measure due to the versatility and complexity of movement inherent in function. An innovative approach to measuring hand kinematics is proposed and validated. The proposed system utilizes the Microsoft Kinect and goes beyond gesture recognition to develop a validated measurement technique of finger kinematics. The proposed system adopted landmark definition (validated through ground truth estimation against assessors) and grip classification algorithms, including kinematic definitions (validated against a laboratory-based motion capture system). The results of the validation show 78% accuracy when identifying specific markerless landmarks. In addition, comparative data with a previously validated kinematic measurement technique show accuracy of MCP ± 10° (average absolute error (AAE) = 2.4°), PIP ± 12° (AAE = 4.8°), and DIP ± 11° (AAE = 4.8°). These results are notably better than clinically based alternative manual measurement techniques. The ability to measure hand movements, and therefore functional dexterity, without interfering with underlying composite movements, is the paramount objective to any bespoke measurement system. The proposed system is the first validated markerless measurement system using the Microsoft Kinect that is capable of measuring finger joint kinematics. It is suitable for home-based motion capture for the hand and, therefore, achieves this objective.

Reliability and validity of the Microsoft Kinect for assessment of manual wheelchair propulsion

“…The Kinect is also being used for the assess ment of postural control [30], gait [31], balance [3], static foot posture [32], body sway [33], and common motor movements [34], all with promising comparisons to three-dimensional gold standard systems. The use of the Kinect as a rehabilitation tool outside of the clinic and in the home [35][36][37] suggests the sensor's portability and supports the recommendation of previous research to incorporate assessment throughout the continuum of care [38].…”

A Preliminary Study of Using Kinect-based Physical Rehabilitation System to Perform Tai Chi Exercises with FLS Evaluation

“…The system developed by Metcalf, et al [17] is used to capture and measure hand kinematics, and can be employed for home-based upper limb rehabilitation. Besides, Kitsunezaki, et al [18] reported four types of Kinect-based physical applications to measure useful parameters such as walking time or joint angle ranges, to determining training effectiveness.…”

Innovative Technologies for Medical Education

“…The rehabilitation exercises are commonly performed in a rehabilitation center, and the physiotherapist identifies and evaluates the movements and motor functions that are being affected. In order to achieve kinetic gains as quickly as possible, patients are encouraged to perform the same exercise movements several times [26]. Patients' learning by movement repetition is crucial for their successful therapy.…”