A Review of Interaction Techniques for Immersive Environments

Abstract

The recent proliferation of immersive technology has led to the rapid adoption of consumer-ready hardware for Augmented Reality (AR) and Virtual Reality (VR). While this increase has resulted in a variety of platforms that can offer a richer interactive experience, the advances in technology bring more variability in display types, interaction sensors and use cases. This provides a spectrum of device-specific interaction possibilities, with each offering a tailor-made solution for delivering immersive experiences to users, but often with an inherent lack of standardisation across devices and applications. To address this, a systematic review and an evaluation of explicit, task-based interaction methods in immersive environments are presented in this paper. A corpus of papers published between 2013 and 2020 is reviewed to thoroughly explore state-of-the-art user studies, which investigate input methods and their implementation for immersive interaction tasks (pointing, selection, translation, rotation, scale, viewport, menu-based and abstract). Focus is given to how input methods have been applied within the spectrum of immersive technology (AR, VR, XR). This is achieved by categorising findings based on display type, input method, study type, use case and task. Results illustrate key trends surrounding the benefits and limitations of each interaction technique and highlight the gaps in current research. The review provides a foundation for understanding the current and future directions for interaction studies in immersive environments, which, at this pivotal point in XR technology adoption, provides routes forward for achieving more valuable, intuitive and natural interactive experiences.

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

“…To answer Q3, we referred to materials from both academia and industries to obtain VR command categories. Initially, we looked into the recent work of Spittle et al [47]. This study conducted a systematic review of the state-of-the-art studies in immersive environments based on papers published between 2013 and 2020.…”

“…In Section 3.2, We selected six VR categories candidates from the referenced paper [47], or official documents of Oculus or HTC Vive, as shown in Table 6. We initially finalized six VR categories candidates, as shown in Table 7.…”

Designing and evaluation of a mixed reality system for crime scene investigation training: a hybrid approach

“…This technology encompasses various forms, including augmented reality (AR), virtual reality (VR), and MR, and has become increasingly prevalent in daily life (Suh and Prophet 2018). The education and learning sector has been impacted by AR, VR, and MR, with a proliferation of VR training applications being developed specifically for medical education (Huber et al 2015;Fang et al 2014;Steinberg et al 2007). These applications facilitate haptic feedback and simulate safe environments, enabling students to practice and enhance their skills without incurring the cost of human or animal testing.…”

CATtalk: An IoT-Based Interactive Art Development Platform

“…These platforms such as Jorjin smart glasses [4] and HTC Vive offer new possibilities for device-specific interaction, but often with an essential lack of standardization for devices and applications. A systematic review [5] provides a foundation for understanding the directions for interaction studies in immersive environments.…”