A cross-device interaction style for mobiles and surfaces

Abstract

Natural forms of interaction have evolved for personal devices that we carry with us (mobiles) as well as for shared interactive displays around us (surfaces) but interaction across the two remains cumbersome in practice. We propose a novel crossdevice interaction style for mobiles and surfaces that uses the mobile for tangible input on the surface in a stylus-like fashion. Building on the direct manipulation that we can perform on either device, it facilitates fluid and seamless interaction spanning across device boundaries. We provide a characterization of the combined interaction style in terms of input, output, and contextual attributes, and demonstrate its versatility by implementation of a range of novel interaction techniques for mobile devices on interactive surfaces.

Eye Pull, Eye Push: Moving Objects between Large Screens and Personal Devices with Gaze and Touch

“…The above techniques were all found to be faster than traditional drag and drop for sufficiently distant targets. Finally, Schmidt et al [19] described a range of interactions made available by combining a mobile phone with a multi-touch surface. Their techniques allow for fluid content transfer, personalisation of the surface and access-control over publicly visible elements.…”

Enabling Symmetric Collaboration in Public Spaces through 3D Mobile Interaction

“…Therefore, one challenge of public displays regarding user experience is the need to give users input expressiveness [11]. In other words, enabling natural input is made by letting users use familiar skills or movements to control the public display.…”

PointerPhone: Using Mobile Phones for Direct Pointing Interactions with Remote Displays

“…Myers et al connected multiple PDAs to a central workstation [17], allowing for data exchange. Additionally, the combination of personal and mobile devices with horizontal tabletop-like displays has been studied [26,28]. Vogt et al compared mouse-based and laser pointer-based interaction regarding their ability to support collaboration in small groups [32].…”