3D Gesture Recognition: An Evaluation of User and System Performance

Wright, Michael; Lin, Chun-Jung; O’Neill, Eamonn; Cosker, Darren; Johnson, Peter N.

doi:10.1007/978-3-642-21726-5_19

Cited by 16 publications

(10 citation statements)

References 12 publications

(12 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition, end users have been recruited to suggest and evaluate the best 2D and 3D gestures for common computer and mobile device tasks such as panning, zooming, etc. (Wobbrock et al, 2009; Fikkert et al, 2010; Wright et al, 2011; Kray et al, 2010; Ruiz et al, 2011). These approaches consider natural language, ease of learning and ability of the system to detect the gesture.…”

Section: Introductionmentioning

confidence: 99%

The design of hand gestures for human–computer interaction: Lessons from sign language interpreters

Rempel

Camilleri

Lee

2014

International Journal of Human-Computer Studies

View full text Add to dashboard Cite

The design and selection of 3D modeled hand gestures for human-computer interaction should follow principles of natural language combined with the need to optimize gesture contrast and recognition. The selection should also consider the discomfort and fatigue associated with distinct hand postures and motions, especially for common commands. Sign language interpreters have extensive and unique experience forming hand gestures and many suffer from hand pain while gesturing. Professional sign language interpreters (N=24) rated discomfort for hand gestures associated with 47 characters and words and 33 hand postures. Clear associations of discomfort with hand postures were identified. In a nominal logistic regression model, high discomfort was associated with gestures requiring a flexed wrist, discordant adjacent fingers, or extended fingers. These and other findings should be considered in the design of hand gestures to optimize the relationship between human cognitive and physical processes and computer gesture recognition systems for human-computer input.

show abstract

Section: Introductionmentioning

confidence: 99%

The design of hand gestures for human–computer interaction: Lessons from sign language interpreters

Rempel

Camilleri

Lee

2014

International Journal of Human-Computer Studies

View full text Add to dashboard Cite

show abstract

“…Hence, further studies are needed to identify what interaction mode is most suitable for a particular task and in what particular context. In relation to this, it is also important to investigate what kinds of gestures are natural and intuitive for certain tasks, similarly to [15] and [47] who evaluated this in the context of non-mobile devices. These studies should also consider social aspects.…”

Section: Discussionmentioning

confidence: 99%

“…Our goal is to verify the usability of this concept, identify typical usage scenarios as well as potential limitations, and investigate useful implementations. For work related to marker-less hand tracking in relation to mobile and augmented reality interaction, we refer to [3,39,41,[46][47][48].…”

mentioning

confidence: 99%

Gesture-based interaction via finger tracking for mobile augmented reality

Hürst

Wezel

2012

Multimed Tools Appl

168

View full text Add to dashboard Cite

The goal of this research is to explore new interaction metaphors for augmented reality on mobile phones, i.e. applications where users look at the live image of the device's video camera and 3D virtual objects enrich the scene that they see. Common interaction concepts for such applications are often limited to pure 2D pointing and clicking on the device's touch screen. Such an interaction with virtual objects is not only restrictive but also difficult, for example, due to the small form factor. In this article, we investigate the potential of finger tracking for gesture-based interaction. We present two experiments evaluating canonical operations such as translation, rotation, and scaling of virtual objects with respect to performance (time and accuracy) and engagement (subjective user feedback). Our results indicate a high entertainment value, but low accuracy if objects are manipulated in midair, suggesting great possibilities for leisure applications but limited usage for serious tasks.

show abstract

“…In addition to display technology, user understanding can be aided through interaction with the on screen environment. Namely using Natural User Interfaces (NUIs), like gestures, to interact with entities instead of a mouse and keyboard [1,[19][20][21][22][23][24][25][26][27][28][29][30][31][32].…”

Section: Natural User Interfacesmentioning

confidence: 99%

Implementing Native Support for Oculus and Leap Motion in a Commercial Engineering Visualization and Analysis Platform

MacAllister¹,

Yeh²,

Winer³

2016

View full text Add to dashboard Cite

While previous research in academia points to the ability of Natural User Interfaces (NUIs) and low-cost display devices to help users better understand a design, there does not exist much research on how these devices can be integrated into existing legacy code used by engineering and design firms. The lack of commercial engineering software that integrates NUIs and low-cost display devices, like the Oculus Rift, can be attributed to the fast changing device market and the lack of awareness many engineering software makers show in emerging interaction paradigms. The lack of work in the area of integrating low-cost immersion devices into commercial software creates a barrier for adoption of these new devices and interaction paradigms. The work presented in this paper details a proof of concept system integrating the Leap Motion and Oculus Rift, into a commercial engineering visualization and analysis package called Siemens' Teamcenter® Lifecycle Visualization Mockup (Mockup). Based on the recorded performance data, hooking up both the Leap and the Oculus results in a frame rate of around 30 frame per second. Indicating that these two devices together can provide real time, fluid interaction in a commercial engineering platform. AbstractWhile previous research in academia points to the ability of Natural User Interfaces (NUIs) and low-cost display devices to help users better understand a design, there does not exist much research on how these devices can be integrated into existing legacy code used by engineering and design firms. The lack of commercial engineering software that integrates NUIs and low-cost display devices, like the Oculus Rift, can be attributed to the fast changing device market and the lack of awareness many engineering software makers show in emerging interaction paradigms. The lack of work in the area of integrating low-cost immersion devices into commercial software creates a barrier for adoption of these new devices and interaction paradigms. The work presented in this paper details a proof of concept system integrating the Leap Motion and Oculus Rift, into a commercial engineering visualization and analysis package called Siemens' Teamcenter® Lifecycle Visualization Mockup (Mockup). Based on the recorded performance data, hooking up both the Leap and the Oculus results in a frame rate of around 30 frame per second. Indicating that these two devices together can provide real time, fluid interaction in a commercial engineering platform.

show abstract

3D Gesture Recognition: An Evaluation of User and System Performance

Cited by 16 publications

References 12 publications

The design of hand gestures for human–computer interaction: Lessons from sign language interpreters

The design of hand gestures for human–computer interaction: Lessons from sign language interpreters

Gesture-based interaction via finger tracking for mobile augmented reality

Implementing Native Support for Oculus and Leap Motion in a Commercial Engineering Visualization and Analysis Platform

Contact Info

Product

Resources

About