User-Defined Gestures for Augmented Reality

Abstract

Abstract.Recently there has been an increase in research towards using hand gestures for interaction in the field of Augmented Reality (AR). These works have primarily focused on researcher designed gestures, while little is known about user preference and behavior for gestures in AR. In this paper, we present our guessability study for hand gestures in AR in which 800 gestures were elicited for 40 selected tasks from 20 participants. Using the agreement found among gestures, a user-defined gesture set was created to guide designers to achieve consistent user-centered gestures in AR. Wobbrock's surface taxonomy has been extended to cover dimensionalities in AR and with it, characteristics of collected gestures have been derived. Common motifs which arose from the empirical findings were applied to obtain a better understanding of users' thought and behavior. This work aims to lead to consistent user-centered designed gestures in AR.

Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry

“…Our results were obtained by adapting the familiar methodology of Fitts' law studies along with a measurement of individuation adopted from motor control research. This is in contrast to existing work in gesture design that has considered elicitation methods to learn about user preferences, intuitiveness, and social acceptability [23,26,31].…”

“…High performance is decisive in activities like text entry, virtual reality, command selection, and gaming. However, previous work has focused on eliciting intuitive multi-finger gestures from users [23,26]. This leaves out many issues, including performance characteristics of gestures involving single and multiple fingers simultaneously.…”

Visualizing Big Data with augmented and virtual reality: challenges and research agenda

“…It should support such actions as: scaling; navigating in visualized 3D space; selecting sub-spaces, objects, groups of visual elements (flow/path elements) and views; manipulating and placing; planning routes of view; generating, extracting and collecting data (based on the reviewed visualized data). A novel system should allow multimodal control by voice and/or gestures in order to make it more intuitive for users as it is shown in [188][189][190] and [191]. Nevertheless, one of the main issues regarding this direction of development is the fact that implementing effective gestural and voice interaction is not a trivial matter.…”

Combining the Virtual and Physical Interaction Environment

“…Gesture recognition taxonomy was implemented referencing the work of HitLabNZ, University of Christchurch, NZ. Their study 'User-defined gestures for augmented reality' [5] records extensive blind testing of various hand poses or 'tasks' that might be implemented within an AR related interface. Using this information three distinct tasks were implemented in the Xuni system animation shown in Table 1.…”