Cross-Device Taxonomy

Abstract

Designing interfaces or applications that move beyond the bounds of a single device screen enables new ways to engage with digital content. Research addressing the opportunities and challenges of interactions with multiple devices in concert is of continued focus in HCI research. To inform the future research agenda of this field, we contribute an analysis and taxonomy of a corpus of 510 papers in the crossdevice computing domain. For both new and experienced researchers in the field we provide: an overview, historic trends and unified terminology of cross-device research; discussion of major and under-explored application areas; mapping of enabling technologies; synthesis of key interaction techniques spanning across multiple devices; and review of common evaluation strategies. We close with a discussion of open issues. Our taxonomy aims to create a unified terminology and common understanding for researchers in order to facilitate and stimulate future cross-device research.

Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools

“…The communication among multiple devices and the interaction techniques for each device have been studied extensively. Brudy et al [11], e. g., surveyed papers from the ACM DL up to May 2018 about cross-device computing taxonomies and gave a detailed list of interaction techniques for different input modalities. As our ultimate vision of a seamless integration of the AR extension into the scientific workflow, we are interested in understanding the possibility of using a common interaction technique to control both sides without switching the devices.…”

“…These devices are thus important to keep in our hybrid system as we want to integrate the 3D extension into their workflow. In addition, previous work pointed out that experts still prefer traditional input even if new forms of intuitive input exist, for example, studies with fluid dynamics researchers [6] and doctors [33]-similar to the wellknown Legacy Bias in interaction design where "users resort to well-known interaction styles even when more effective and novel techniques are available" [11].…”

GazeConduits: Calibration-Free Cross-Device Collaboration through Gaze and Touch

“…Cross-device systems [1] afford new interactions for sense making [18,48], curation [2], sharing media [19], and collaborative content editing [16]. Usually, these setups distribute an interface across a number of devices like tablets, smartphones, interactive walls or tabletops, and provide techniques to effectively use the input/output modalities of these multi-device setups.…”

“…A major research area of cross-device work is investigating effective techniques for a person to interact with this ecology of devices [1]. Inspired by early seminal work such as Rekimoto's Pick-and-Drop [29], different techniques have been designed and evaluated for linking devices and transferring digital content between them [5,6,8,24,35].…”

Where is that Feature?

“…A large focus of the existing research on cross-device interactions has been on synchronous interactions [3]. In this paper, we focus on asynchronous interactions (i.e., where users use the mobile version and the PC version sequentially) and learnability (i.e., transfer learning) across devices.…”