A Taxonomy of Sounds in Virtual Reality

Jain, Dhruv; Junuzovic, Sasa; Ofek, Eyal; Sinclair, Mike; Porter, John R.; Yoon, Chris; Machanavajhala, Swetha; Morris, Meredith Ringel

doi:10.1145/3461778.3462106

Cited by 18 publications

(5 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As suggested by Jain et al [68], "designers make creative decisions for sounds in VR to be more pleasant and manageable". In our design process, we iterated the vehicle sounds multiple times to test different characteristics and how they interacted with the virtual environment.…”

Section: Virtual Urban Field Studies For Evaluating Interaction Designmentioning

confidence: 99%

“…Our sound production approach focused on applying just enough processing to situate the sound effectively in the VE. We employed some reverb to introduce approximations of diffused reflections based on suggestions by Jain et al [27], which decreased as the autonomous vehicle approached the user. More accurate simulation of the acoustic reverberation conditions would be possible through measuring multiple spatial impulse responses in the testing environment [42].…”

Section: Virtual Av Sound Designmentioning

confidence: 99%

See 1 more Smart Citation

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Dongas,

Grace,

Gillespie

et al. 2023

MTI

View full text Add to dashboard Cite

In this study, we propose the use of virtual urban field studies (VUFS) through context-based interface prototypes for evaluating the interaction design of auditory interfaces. Virtual field tests use mixed-reality technologies to combine the fidelity of real-world testing with the affordability and speed of testing in the lab. In this paper, we apply this concept to rapidly test sound designs for autonomous vehicle (AV)–pedestrian interaction with a high degree of realism and fidelity. We also propose the use of psychometrically validated measures of presence in validating the verisimilitude of VUFS. Using mixed qualitative and quantitative methods, we analysed users’ perceptions of presence in our VUFS prototype and the relationship to our prototype’s effectiveness. We also examined the use of higher-order ambisonic spatialised audio and its impact on presence. Our results provide insights into how VUFS can be designed to facilitate presence as well as design guidelines for how this can be leveraged.

show abstract

Section: Virtual Urban Field Studies For Evaluating Interaction Designmentioning

confidence: 99%

Section: Virtual Av Sound Designmentioning

confidence: 99%

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Dongas,

Grace,

Gillespie

et al. 2023

MTI

View full text Add to dashboard Cite

show abstract

“…Audio can serve many functions within an interactive experience [18]. In games audio can provide specific information to a player [20], improve performance [19], affect player behaviour (e.g.…”

Section: Aural Presence In Vrmentioning

confidence: 99%

“…• Dynamic Audio: Automatically lower VR application audio (to 25% the starting volume) based prior work [31] • Remove Sound Effect Audio: Remove sound effect audio, background audio remains at full volume [18,35,37,38] • Remove Background Audio: Remove background audio, sound effect audio remains at full volume [18,35,37,38] • Remove All Audio: Remove background and sound effect audio (all audio) [33,39] Dynamic Audio was included as prior work [31] found it could effectively direct a VR user's attention toward nearby sounds but did not investigate how effectively it could facilitate a bystander-VR user interaction. Removing partial audio (Remove Sound Effect Audio & Remove Background Audio) were included to explore how the phenomena of removing audio without altering a VR user's presence [35,37,38] might be used to facilitate verbal bystander-VR user interactions.…”

Section: Design Of Our Audio Manipulationsmentioning

confidence: 99%

Exploring Manipulating In-VR Audio To Facilitate Verbal Interactions Between VR Users And Bystanders

O’Hagan

Williamson

Khamis

et al. 2022

Proceedings of the 2022 International Conference on Advanced Visual Interfaces

View full text Add to dashboard Cite

Despite recent work investigating how VR users can be made aware of bystanders, few have explored how bystander-VR user interactions may be facilitated by, for example, increasing the user's auditory awareness so they can better converse with bystanders. Through a lab study (N=15) we investigated 4 approaches of manipulating in-VR audio to facilitate verbal interactions between a VR user and bystander: (1) dynamically reducing application volume, (2) removing background audio, (3) removing sound effects and (4) removing all audio. Our results show audio manipulations can be used to significantly improve a VR user's auditory awareness at the cost of reducing sense of presence in VR. They also show most preferred increased awareness be balanced with decreased presence in VR, however, they also identify a subset of participants who prioritised increasing awareness no matter the cost to presence. CCS CONCEPTS• Human-centered computing → Virtual reality.

show abstract

“…Thus, future work should also explore the addition of new branches in the design space to create multi-modal feedback including auditory and haptic feedback for contact augmentation. A starting point could be the work of [16] who proposed a taxonomy for sound in VR, or the works of [39] which explores the interactions between visual and haptic feedback mechanisms. Finally, even if we focused on two very representative XR application scenarios (industrial and entertainment), other scenarios could also be explored in future work.…”

Section: Limitations and Future Workmentioning

confidence: 99%

“Kapow!”: Studying the Design of Visual Feedback for Representing Contacts in Extended Reality

Cauquis

Mercado

Casiez

et al. 2022

Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Distributed under a Creative Commons Attribution -NonCommercial -NoDerivatives| 4.0

show abstract

A Taxonomy of Sounds in Virtual Reality

Cited by 18 publications

References 43 publications

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Exploring Manipulating In-VR Audio To Facilitate Verbal Interactions Between VR Users And Bystanders

“Kapow!”: Studying the Design of Visual Feedback for Representing Contacts in Extended Reality

Contact Info

Product

Resources

About