Audio Legends: Investigating Sonic Interaction in an Augmented Reality Audio Game

Abstract

Augmented Reality Audio Games (ARAG) enrich the physical world with virtual sounds to express their content and mechanics. Existing ARAG implementations have focused on exploring the surroundings and navigating to virtual sound sources as the main mode of interaction. This paper suggests that gestural activity with a handheld device can realize complex modes of sonic interaction in the augmented environment, resulting in an enhanced immersive game experience. The ARAG “Audio Legends” was designed and tested to evaluate the usability and immersion of a system featuring an exploration phase based on auditory navigation, as well as an action phase, in which players aim at virtual sonic targets and wave the device to hit them or hold the device to block them. The results of the experiment provide evidence that players are easily accustomed to auditory navigation and that gestural sonic interaction is perceived as difficult, yet this does not affect negatively the system’s usability and players’ immersion. Findings also include indications that elements, such as sound design, the synchronization of sound and gesture, the fidelity of audio augmentation, and environmental conditions, also affect significantly the game experience, whereas background factors, such as age, sex, and game or music experience, do not have any critical impact.

Immersive Applications in Museums: An Analysis of the Use of XR Technologies and the Provided Functionality Based on Systematic Literature Review

“…Furthermore, we can assume that the decision to carry or not a device depends on its size, weight, ergonomics, perceived usefulness, and expected enjoyment, with a possibly varying decision threshold existing among different users. Furthermore, we can hypothesize that the need for backpack PCs will be diminished as there are examples of Audio AR that solely need a mobile device [56] and new high-end standalone VR headsets are available.…”

“…At this point, the reader would possibly question if the need for the backpack PC is necessary. Literature provides us with examples [56] of Audio AR applications providing position and orientation tracking and orientation-dependent binaural stimuli without the need of a backpack PC.…”

Design Recommendations for a Collaborative Game of Bird Call Recognition Based on Internet of Sound Practices

“…However, more active modes of interaction can enhance users' communication in competitive or collaborative contexts. In [34] a positive connection was shown between challenging mechanics requiring the performance of gestures with the satisfaction gained from the experience. In [35] the behavior of the virtual sound sources that players need to locate is controlled by the movement of other antagonizing players, whereas in [36] players take up different roles and need to coordinate their actions in the augmented space to achieve the game goal.…”

Towards Citizen Science for Smart Cities: A Framework for a Collaborative Game of Bird Call Recognition Based on Internet of Sound Practices

“…However, more active modes of interaction can enhance users' communication in competitive or collaborative contexts. In [33] a positive connection was shown between challenging mechanics requiring the performance of gestures with the satisfaction from the experience. In [34] the behavior of the virtual sound sources that players need to locate is controlled by the movement of other antagonizing players, whereas in [35] players take up different roles and need to coordinate their actions in the augmented space to achieve the game goal.…”