User-defined gestures for surface computing

Wobbrock, Jacob O.; Morris, Meredith Ringel; Wilson, Andrew

doi:10.1145/1518701.1518866

Cited by 1,011 publications

(1,046 citation statements)

References 28 publications

Supporting

Mentioning

972

Contrasting

Unclassified

Order By: Relevance

“…Similarly participants preferred a oneand two-finger swipe up/down (as on a mixer console) to change the volume (67%). We therefore decided to support both one-and two-finger interactions for all three commands as Wobbrock et al also reported similar results [33].…”

Section: Figmentioning

confidence: 83%

Comparing Input Modalities for Peripheral Interaction: A Case Study on Peripheral Music Control

Hausen¹,

Richter²,

Hemme³

et al. 2013

Human-Computer Interaction – INTERACT 2013

View full text Add to dashboard Cite

Abstract. In graphical user interfaces, every application usually asks for the user's full attention during interaction with it. Even marginal side activities often force the user to switch windows, which results in attention shifts and increased cognitive load. Peripheral interaction addresses this problem by providing input facilities in the periphery of the user's attention by relying on divided attention and human capabilities such as proprioception and spatial memory. Recent work shows promising results by shifting tasks to the periphery for parallel task execution. Up to now, most of these interfaces rely on tag-based objects, tokens or wearable devices, which need to be grasped and manipulated, e.g., by turning, moving or pressing the device.To explore this design space further, we implemented three modalities for peripheral interaction with a desktop audio player application -graspable interaction, touch and freehand gestures. In an eight-week in-situ deployment, we compared the three modalities to each other and to media keys (as the state-ofthe-art approach). We found that all modalities can be successfully used in the (visual and attentional) periphery and reduce the amount of cognitive load when interacting with an audio player.With this work we intend to (1) illustrate the variety of possible modalities beyond graspable interfaces, (2) give insights on manual peripheral interaction in general and the respective modalities in particular and (3) elaborate on paper based prototypes for the evaluation of peripheral interaction.

show abstract

Section: Figmentioning

confidence: 83%

Comparing Input Modalities for Peripheral Interaction: A Case Study on Peripheral Music Control

Hausen¹,

Richter²,

Hemme³

et al. 2013

Human-Computer Interaction – INTERACT 2013

View full text Add to dashboard Cite

show abstract

“…Early stage development that looks past technical restrictions is one way to avoid expending effort on gestures that are not acceptable [8]. However, as Wobbrock et al [10] point out, reliability of recognition is nevertheless an important criterion for early prototypes. Our design approach is a hybrid of the technology-oriented and human-centered styles; we aimed for reliable recognition through designed gestures, but carried out a series of design workshops to ensure the gestures are also acceptable.…”

Section: Designing Gesture Interactionsmentioning

confidence: 99%

Designing Gesture-Based Control for Factory Automation

Heimonen¹,

Hakulinen²,

Turunen³

et al. 2013

Human-Computer Interaction – INTERACT 2013

View full text Add to dashboard Cite

Abstract. We report the development and evaluation of a gesture-based interaction prototype for controlling the loading station of a factory automation system. In this context, gesture-based interaction has the potential to free users from the tedious physical controls but it must also account for safety considerations and users' perceptions. We evaluated the gesture interaction concept in the field to understand its applicability to industrial settings. Our findings suggest that gesture-based interaction is an emotional, physically charged experience that has the potential to enhance the work process. Participants' feedback also highlighted challenges related to the reliability of gesture recognition technology in the workplace, the perceived professionalism of gesture-based interaction, and the role of physical feedback in promoting feeling of control. Our results inform the development of gesture-based interaction for similar contexts.Keywords: Gesture-based interaction, emotions, user experience, field study. IntroductionGesture-based interaction could provide many benefits as an alternative to physical controls in industrial settings, where the manual operation of machinery can be ergonomically challenging and hazardous or is governed by safety regulations. Several characteristics of gesture-based systems affect their usability in such settings, including technical aspects such as latency of operation, stability, resolution, and precision [1], as well as human-centered aspects such as intuitiveness, ergonomics, and ease of gesture performance and recall [2]. Appropriately designed systems must balance these sometimes contradictory concerns. We report the findings from a year-long design and development process of a gesture-based interaction concept, focusing on the results of evaluations conducted in real context of use. The overall goal of the research was to create novel interaction concepts for metal workshops and to study their potential in real work tasks. Our research was aimed at answering the following questions:

show abstract

“…The aim of this study was to investigate which gestures felt natural to participants for operating a touch screen DP system. Guessability studies (Nielsen et al, 2003, Wobbrock et al, 2009) are a user-centred design method for generating gesture sets that are easy to perform and remember, intuitive, and adequate to the task. Users are asked to suggest gestures for a given set of elemental core operations or tasks.…”

Section: The Potential For Multi-touchmentioning

confidence: 99%

“…Buxton (2007): bi-manual or multi-finger interaction is more efficient than one control point). We compared multi-touch gesture interaction, using a gesture set developed through a guessability study (Wobbrock et al, 2009), with traditional button and menu-based touch interaction to control the commercially available Rolls-Royce Marine DP system in a moving versus a static environment. So far, there has been little research on the use of multi-touch gesture interaction within safety-critical domains.…”

Section: Introductionmentioning

confidence: 99%