iGesture: A General Gesture Recognition Framework

Abstract

With the emergence of digital pen and paper interfaces, there is a need for gesture recognition tools for digital pen input. While there exists a variety of gesture recognition frameworks, none of them addresses the issues of supporting application developers as well as the designers of new recognition algorithms and, at the same time, can be integrated with new forms of input devices such as digital pens. We introduce iGesture, a Java-based gesture recognition framework focusing on extensibility and cross-application reusability by providing an integrated solution that includes tools for gesture recognition as well as the creation and management of gesture sets for the evaluation and optimisation of new or existing gesture recognition algorithms. In addition to traditional screen-based interaction, iGesture provides a digital pen and paper interface.

GestUI: A Model-driven Method and Tool for Including Gesture-based Interaction in User Interfaces

“… Quill supports Rubine, one of the first algorithms to recognise mouse and pen-based gestures [7]. It employs a statistical method of gesture recognition based on a set of 13 geometric features [21]. It has been used for recognising single-stroke gestures like the unistroke or Grafitti alphabets [22].…”

“…Activity A5, "Test gestures", in this activity the gesture catalogue model is transformed into language supported by the gesture recognition tool (i.e. XML) so that both the developer and the user can test the gestures using the gesture recognition tool (we currently support three gesture testing platforms: quill [8], $N [6] and iGesture [21]). We apply M2T transformation to generate the platform-specific gesture catalogue for each gesture recognition tool.…”

gestUI: a model-driven method for including gesture-based interaction in user interfaces

“…Signer et al [48] describe iGesture, a Java framework for the development and deployment of stroke-based gesture recognition algorithms. iGesture has two schemas to store the gesture definition: (i) an open source object database as a primary storage container and, (ii) XML which simply serialise the data object into a document based on the x-stream Java library.…”

“…An important feature of this algorithm is that gestures are not described programmatically but they are learned by examples. It employs a statistical method of gesture recognition based on a set of 13 geometric features [48]. It has been used for recognising single-stroke gestures like the unistroke or Grafitti alphabets [49].…”

“…This algorithm classifies gestures based on regular expressions and describes them according to the eight cardinal points and statistical information. These regular expressions are then applied to input gestures and, in the case that a class description matches the input string, the corresponding gesture class is returned as a result [48].…”