Touch-Less Java Based Hand Tracking System to Control an Artificial Arm

Abstract

Modern sensing technologies create new possibilities to control mobile robots without any dedicated manipulators. In this article authors present a novel method that enables driving of the Mindstorms NXT artificial arm with Microsoft Kinect, using gesture recognition and hand tracking. To imitate the movement of an artificial robotic arm, an algorithm of the human-computer interaction is employed using skeleton tracking and gesture control in 3D space. The solution is implemented using free, open source software, Java based.