User-defined gestures for connecting mobile phones, public displays, and tabletops

Abstract

Gestures can offer an intuitive way to interact with a computer. In this paper, we investigate the question whether gesturing with a mobile phone can help to perform complex tasks involving two devices. We present results from a user study, where we asked participants to spontaneously produce gestures with their phone to trigger a set of different activities. We investigated three conditions (device configurations): phone-to-phone, phone-to-tabletop, and phone to public display. We report on the kinds of gestures we observed as well as on feedback from the participants, and provide an initial assessment of which sensors might facilitate gesture recognition in a phone. The results suggest that phone gestures have the potential to be easily understood by end users and that certain device configurations and activities may be well suited for gesture control.

Towards user-defined multi-touch gestures for 3D objects

“…Ruiz et al elicit user-defined gestures for mobile interaction and find several themes similar to the ones we are exploring: actions that mimic normal use (such as putting a mobile phone to the ear for a motion gesture to answer a call), and real-world metaphors (such as placing a phone face down to hang up a phone call as you would have with a rotary phone) [11]. Kray et al also discover user-defined gestures that act as metaphors for connecting mobile devices, displays and tabletops, such as starting with two phones near each other and then pulling away to disconnect them [5]. Kurdyukova et al investigate gestures for data transfer between iPads and other devices, finding that both experienced and inexperienced users rely on real-life metaphors when thinking of well-matching gestures [6].…”

Memorability of pre-designed and user-defined gesture sets

“…Some examples of gestures sets include the pen-based Rubine gesture set [28], Graffiti, Unistrokes [10] and the $1 gesture set [36]. Recently, gesture sets have also been intensively studied for surfaces and other multi-touch devices [8,35,14,16,25] and for 3D fullbody-motion tracking sensors [17,30,32,33].…”

Constructing a 3D Multiple Mobile Medical Imaging System through Service Science, Management, Engineering and Design

“…After these identification processes, users can interchange information among personal mobile devices and the public touch screen. Kray et al [27] investigated whether gesturing with a mobile phone can help to perform complex tasks involving two devices, and recommended several possible techniques for gesture recognition; for example, measuring the signal strengths or runtime differences between signals to estimate the distance between mobile devices and using this to recognize devices' approaching or pulling away gestures. Hinckley [28] provided a different gesture recognition method to recognize bumping between mobile devices.…”