Extracting a Definition and Taxonomy for Audio Augmented Reality (AAR) Using Grounded Theory

Abstract

The concept of Augmented Reality (AR) has evolved over the years since its inception in 1957. However, as of today, AR is mostly realized using a visual medium. Almost all applications of AR rely on the user’s ability to see. A few recent works have attempted to explore a new modality for AR–e.g., audio. However, the concept of using audio to augment reality has been considered debatable and there is no specific definition of the concept. To better understand this new concept, we launched a study using Grounded Theory to develop a definition and taxonomy for the concept of Audio Augmented Reality (AAR). This paper shares the preliminary results based on the activities conducted thus far, and hopes to generate discussion on using audio to augment reality within the Human Factors community.

Enhancing Art Gallery Visitors' Experiences through Audio Augmented Reality Technology

“…This was true for all the paintings except for 'The Return', where the Enhanced AAR cues contained too many low frequency notes and reverb that did not match with the clearly depicted light source and bright colors present in the painting. The sense of immersion that participants experienced also directly corresponds to the Immersion dimension of AAR, and lends further credibility to the same (Dam et al, 2022).…”

“…The dimensions for audio AR are similar yet unique from the dimensions of visual AR–Customization, Immersion, and User Context. Customization is the modification of auditory cues for the intended user, Immersion is the extent to which users feel engaged in an augmented reality, and User Context is the extent to which the auditory cues are helpful for the user’s primary task (Dam et al, 2022). Auditory cues, that fit these requirements, are a way to augment users’ experiences in a visual art gallery using an alternate modality.…”

A Review of Milgram and Kishino’s Reality-Virtuality Continuum and a Mathematical Formalization for Combining Multiple Reality-Virtuality Continua

“…A new approach that aims to combine virtual and physical world in a novel way was introduced by Lindlbauer et al [57] through the concept of Remixed Reality, for which a fourdimension taxonomy was proposed: (1) spatial modification (reshape, move/copy, erase, scale), (2) appearance modification (recolor, relight, artistic), (3) viewpoint modification (teleport, arbitrary movement, portals, and change projection), and (4) temporal modification (playback, pause, reverse playback, playback with changed speed, loop). A last contribution in our SLR was introduced recently by Dam et al [58] when, informed by the conclusions of a workshop where the primary goal was to understand and define Audio Augmented Reality (AAR), the authors conducted a literature review on this field, and finally proposed a three dimensional space for AAR. This space is compound of (1) Immersion, ensuring that the sounds lead to enhanced perceptions or augmented experiences, (2) User context, meaning the information must be applicable and assistive to the user's primary task, and (3) Customization, meaning sounds may be audible to more than one user in the environment, but they are customized to be meaningful and unique only for the intended user.…”