Which Shape Representation Is the Best for Real-Time Hand Interface System?

Abstract

Abstract. Hand is a very convenient interface for immersive human-computer interaction. Users can give commands to a computer by hand signs (hand postures, hand shapes) or hand movements (hand gestures). Such a hand interface system can be realized by using cameras as input devices, and software for analyzing the images. In this hand interface system, commands are recognized by analyzing the hand shapes and its trajectories in the images. Therefore, success of the recognition of hand shape is vital and depends on the discriminative power of the hand shape representation. There are many shape representation techniques in the literature. However, none of them are working properly for all shapes. While a representation leads to a good result for a set of shapes, it may fail in another one. Therefore, our aim is to find the most appropriate shape representation technique for hand shapes to be used in hand interfaces. Our candidate representations are Fourier Descriptors, Hu Moment Invariant, Shape Descriptors and Orientation Histogram. Based on widely-used hand shapes for an interface, we compared the representations in terms of their discriminative power and speed.

HandVR: a hand-gesture-based interface to a video retrieval system

“…This method is widely used to represent hand shapes and is easy to implement, fast, and robust. Moreover, the descriptors are invariant to translation, rotation, and scaling [12], which is also crucial in hand shape recognition in our case.…”

“…This is achieved with a decision tree classifier using shape descriptors computed from the segmented hand regions. Among many existing classifiers, we selected the decision tree classifier, for its simplicity and efficiency [12].…”

Motion Identification of the Human Agent's Arm in Case of Grabbing a Cylindrical Object and Transposing these in Control Rules for an Industrial Robot

“…Hand is a very convenient interface for immersive human-computer interaction. Users can give commands to a computer by hand signs or hand movements [2].…”