Interaction with Virtual Content using Augmented Reality

Abstract

Assembly procedures are a common task in several domains of application. Augmented Reality (AR) has been considered as having great potential in assisting users while performing such tasks. However, poor interaction design and lack of studies, often results in complex and hard to use AR systems. This paper considers three different interaction methods for assembly procedures (Touch gestures in a mobile device; Mobile Device movements; 3D Controllers and See-through HMD). It also describes a controlled experiment aimed at comparing acceptance and usability between these methods in an assembly task using Lego blocks. The main conclusions are that participants were faster using the 3D controllers and Video see-through HMD. Participants also preferred the HMD condition, even though some reported light symptoms of nausea, sickness and/or disorientation, probably due to limited resolution of the HMD cameras used in the video see-through setting and some latency issues. In addition, although some research claims that manipulation of virtual objects with movements of the mobile device can be considered as natural, this condition was the least preferred by the participants. CCS Concepts: • Human-centered computing → Mixed / augmented reality; User studies; Usability testing; • Applied computing → Computer-aided manufacturing;

A Review of Interaction Techniques for Immersive Environments

“…3 studies combined devices in tandem for a seamless multi-platform experience [36,87,100]. The remaining papers compared headworn and handheld interactions [50]. Again, assessments primarily concerned the influence of task, which was addressed in 5 papers, and output, which was explored in 3 papers.…”

Systematic Review of Multimodal Human–Computer Interaction

“…Augmented reality enables an interactive real-world experience enhanced with perceptual computer-generated information [17], allowing users to combine the real world with various computer-generated content to enhance the real world with information from a computer [18].…”

Comparing Desktop vs. Mobile Interaction for the Creation of Pervasive Augmented Reality Experiences

“…In our work, we focus on the overlaying of computer-generated graphics in the scene [ 5 , 6 , 7 ]. This entails the combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects [ 8 , 9 , 10 ]. In recent times, AR technology has become more prevalent within numerous domains, such as advertising, medicine, education, robotics, entertainment, tourism, and others.…”

“…The creation of these experiences poses several challenges [ 8 , 11 , 12 , 13 , 14 ], namely the time and technical expertise required to create such content, which are the main reasons preventing its widespread use; tracking of the user, i.e., understanding the user pose in relation to the environment; content management, i.e., making different types of digital content available (e.g., text, images, videos, 3D models, sound); adequate configuration of virtual content, i.e., configuring the experiences by choosing where augmented content is placed in the real world, as well as adequate mechanisms to display, filter, and select the relevant information at any given moment; uninterrupted display of information, i.e., making these continuous experiences available in order for them to be explored by the target audiences through adequate mechanisms; suitable interaction, i.e., providing usable interaction techniques to the devices being used, allowing easy-to-use authoring features; accessibility, which must be ensured for inexperienced users, while also providing experts with the full potential of the technology. Lastly, given the effects of the COVID-19 pandemic, which have abruptly upended normal work routines, it seems more relevant than ever to also consider remote features for these emerging experiences.…”