Synchronous Gestures in Multi-Display Environments

Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

Hinckley

Greenberg

2012

190

196

GroupTogether is a system that explores cross-device interaction using two sociological constructs. First, Fformations concern the distance and relative body orientation among multiple users, which indicate when and how people position themselves as a group. Second, micromobility describes how people orient and tilt devices towards one another to promote fine-grained sharing during co-present collaboration. We sense these constructs using: (a) a pair of overhead Kinect depth cameras to sense small groups of people, (b) low-power 8GHz band radio modules to establish the identity, presence, and coarse-grained relative locations of devices, and (c) accelerometers to detect tilting of slate devices. The resulting system supports fluid, minimally disruptive techniques for co-located collaboration by leveraging the proxemics of people as well as the proxemics of devices.

Section: B7 Avoid Persistent Spatial Invasion When Users Gesturedmentioning

confidence: 99%

Section: Micro-mobility For Tabletops and Other Interactionsmentioning

confidence: 99%

Cross-device interaction via micro-mobility and f-formations

Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

Hinckley

Greenberg

2012

190

196

“…For example, Luff and Heath (1998) has since been applied to other areas, particularly the spacing and orientation of digital objects on tabletop systems to denote personal territoriality as well as groupings of objects (Everitt et al 2006). Other related techniques include adjusting the posture of dual-screen devices ), bumping and pouring (Hinckley 2003), stitching (Ramos et al 2009), and "chucking" content from one device to another (Hassan et al 2009) (also see our earlier discussion in Sections §2.2.1 and §2.2.2).…”

Section: Using Theory To Motivate Group Interaction Techniquesmentioning

confidence: 99%

“…One example is both simultaneous shaking their handheld device (Holmquist et al 2001). Similarly, a stitching gesture can be used, where one person start a gesture on one device, which is then continued on the other; this can only be done if the devices are nearby (Ramos et al 2009). …”

Section: Connection As a Consequence Of Close Proximitymentioning

confidence: 99%

Proxemic interactions in ubiquitous computing ecologies

CHI '11 Extended Abstracts on Human Factors in Computing Systems

2011

In this dissertation, I explore how the knowledge of people's and devices' spatial relationships -called proxemics -can be applied to the design of ubiquitous computing (ubicomp) interactions. Edward Hall's proxemics theory describes how people use spatial relationships -such as varying their distance or orientation -to mediate their interactions with other people around them. But in spite of the opportunities presented by people's natural understanding of proxemics, only a relatively small number of ubicomp installations incorporate proxemic information within interaction design.Therefore, my goal in this dissertation research is to inform the design of future proxemic-aware devices that -similar to people's natural expectations and use of proxemics -allow increasing connectivity and interaction possibilities when in proximity to people, other devices, or objects. Towards this goal, I explore how the finegrained knowledge of proxemic relationships between the entities in small-space ubicomp ecologies can be exploited in interaction design. In particular, I provide the following three major contributions: First, I operationalize proxemics for ubicomp interaction with the Proxemic Interactions framework that serves to guide the design of ubicomp applications. The framework describes how designers can consider fine-grained proxemic information to mediate people's interactions with digital devices, such as large digital surfaces or portable personal devices. I identify five key dimensions of proxemic measures (distance, orientation, movement, identity, and location) to consider when designing proxemicaware ubicomp systems. I also identify the gradual engagement design pattern as one particular strategy that allows designing system interactions that move from awareness, to reveal, to interaction.-iiiSecond, I design the Proximity Toolkit allowing ubicomp developers to rapidly prototype proxemic-aware ubicomp systems. The toolkit simplifies the development process by supplying higher-level information about proxemic relationships between the entities in ubicomp ecologies through an event-driven API and visual inspection tools.Third, I explore the design of three case studies of proxemic-aware systems that react continuously to people's and devices' proxemic relationships. The case studies explore the application of proxemics in small-space ubicomp ecologies by considering first person-to-device, then device-to-device, and finally person-to-person & device-to-device proxemic relationships. Together, they validate the toolkit's versatility and the application of the Proxemic Interactions framework.-iv -

“…To enable cross-device interactions [19], the system first needs knowledge about the presence and position of other devices around it. Various techniques establish such connections: synchronous gestures [27] that pair devices when stitching stroke across the screens [10]; other approaches include shaking devices simultaneously [12], bumping [27], or performing pinching gestures [24]. Another approach is to use custom sensing hardware, for example infrared-, hall-, or radio-based position sensing.…”

Section: Related Workmentioning

confidence: 99%

HuddleLamp

Rädle

Jetter

Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

et al. 2014

106

We present HuddleLamp, a desk lamp with an integrated RGB-D camera that precisely tracks the movements and positions of mobile displays and hands on a table. This enables a new breed of spatially-aware multi-user and multi-device applications for around-the-table collaboration without an interactive tabletop. At any time, users can add or remove displays and reconfigure them in space in an adhoc manner without the need of installing any software or attaching markers. Additionally, hands are tracked to detect interactions above and between displays, enabling fluent cross-device interactions. We contribute a novel hybrid sensing approach that uses RGB and depth data to increase tracking quality and a technical evaluation of its capabilities and limitations. For enabling installation-free ad-hoc collaboration, we also introduce a web-based architecture and JavaScript API for future HuddleLamp applications. Finally, we demonstrate the resulting design space using five examples of cross-device interaction techniques.