A low-cost non-intrusive spatial hand tracking pipeline for product-process interaction

Abstract

Hands are the sensors and actuators for many design tasks. While several tools exist to capture human interaction and pose, many are expensive and require intrusive measurement devices to be placed on participants and often takes them out of the natural working environment. This paper reports a novel workflow that combines computer vision, several Machine Learning algorithms, and geometric transformations to provide a low-cost non-intrusive means of spatially tracking hands. A ±3mm position accuracy was attained across a series of 3-dimensional follow the path studies.