Auditory-Induced Presence in Mixed Reality Environments and Related Technology

Larsson, Pontus; Väljamäe, Aleksander; Västfjäll, Daniel; Tajadura‐Jiménez, Ana; Kleiner, Mendel

doi:10.1007/978-1-84882-733-2_8

Cited by 49 publications

(32 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similarly, Riecke et al [2008b] demonstrated that biomechanically induced circular vection (i.e., the illusion of self-rotation induced when sitting stationary above a rotating turntable and stepping along the turntable) can be enhanced by providing concurrently rotating sound fields. Apart from such specific vection-enhancing effect, adding spatialized auditory cues to VR simulations can have a number of further advantages, as is discussed in more detail in Larsson et al [2009], , and : Adding auditory cues is known to increase presence in the simulated world, especially if spatialized auditory cues are used that are perceived as properly externalized and can be well localized, for example by using generic HRTFs [Hendrix and Barfield 1996;Ozawa et al 2004] or individualized HRTFs [Väljamäe et al 2004]. This is in agreement with the observed presence-facilitating effect of spatialized auditory cues in the current study.…”

Section: Why Should Sound Be Added To a Vr Simulation?mentioning

confidence: 99%

Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality

Riecke

Väljamäe

Schulte-Pelkum

2009

ACM Trans. Appl. Percept.

Self Cite

View full text Add to dashboard Cite

While rotating visual and auditory stimuli have long been known to elicit self-motion illusions ("circular vection"), audiovisual interactions have hardly been investigated. Here, two experiments investigated whether visually induced circular vection can be enhanced by concurrently rotating auditory cues that match visual landmarks (e.g., a fountain sound). Participants sat behind a curved projection screen displaying rotating panoramic renderings of a market place. Apart from a no-sound condition, headphone-based auditory stimuli consisted of mono sound, ambient sound, or low-/high-spatial resolution auralizations using generic head-related transfer functions (HRTFs). While merely adding nonrotating (mono or ambient) sound showed no effects, moving sound stimuli facilitated both vection and presence in the virtual environment. This spatialization benefit was maximal for a medium (20 • × 15 • ) FOV, reduced for a larger (54 • × 45 • ) FOV and unexpectedly absent for the smallest (10 • × 7.5 • ) FOV. Increasing auralization spatial fidelity (from low, comparable to five-channel home theatre systems, to high, 5 • resolution) provided no further benefit, suggesting a ceiling effect. In conclusion, both self-motion perception and presence can benefit from adding moving auditory stimuli. This has important implications both for multimodal cue integration theories and the applied challenge of building affordable yet effective motion simulators.

show abstract

Section: Why Should Sound Be Added To a Vr Simulation?mentioning

confidence: 99%

Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality

Riecke

Väljamäe

Schulte-Pelkum

2009

ACM Trans. Appl. Percept.

Self Cite

View full text Add to dashboard Cite

show abstract

“…As far as the sensory dimension is concerned, on the one hand, the listed objectives were motivated by results indicating the importance of providing stimuli from different sensory modalities on the sense of presence in VEs (Dinh et al 1999;Biocca et al 2002;Larsson et al 2010;Fröh-lich and Wachsmuth 2013). On the other hand, those objectives were derived from the fact that temporal, spatial, and semantic coherences are important factors for multisensory integration (Spence 2007;Calvert et al 2004): Incoherence between stimuli provided to different sensory modalities affects negatively their binding into a unitary percept and this results in breaks in presence (Harvey and Sanchez-Vives 2005).…”

Section: Designing the User's Experiencementioning

confidence: 99%

Designing presence for real locomotion in immersive virtual environments: an affordance-based experiential approach

Turchet

2015

Virtual Reality

View full text Add to dashboard Cite

This paper describes a framework for designing systems for real locomotion in virtual environments (VEs) in order to achieve an intense sense of presence. The main outcome of the present research is a list of design features that the virtual reality technology should have in order to achieve such a goal. To identify these features, an approach based on the combination of two design strategies was followed. The first was based on the theory of affordances and was utilized to design a generic VE in which the affordances of the corresponding real environment could be evoked. The second was the experiential design applied to VEs and was utilized to create an experience of locomotion corresponding to that achievable in a real environment. These design strategies were chosen because of their potential to enhance the sense of presence. The proposed list of features can be utilized as an instrument that allows VE designers to evaluate the maturity of their systems and to pinpoint directions for future developments. A survey analysis was performed using the proposed framework, which involved three case studies to determine how many features of the proposed framework were present and their status. The result of such analysis represented a measure of the completeness of the systems design, of the affordances provided to the user, and a prediction of the sense of presence.

show abstract

“…Larson et al [18] suggest that the spatial properties of virtual auditory environments have been of significant importance since the introduction of stereo sound in the 1930s. Stating that spatial sound is used to simulate an auditory reality that gives the user the impression they are surrounded by a 3D virtual environment.…”

Section: The Importance Of Spatial Audiomentioning

confidence: 99%

“…The realistic reproduction of three-dimensional auditory environments through headphones, known as binaural-based spatial audio, is dependent upon the correct simulation of the interaural differences and spectral shaping cues caused by the torso, head and pinnae called Head Related Transfer Functions (HRTF) [31]. HRTF's are the functions of both frequency and position for both azimuth and elevation, containing direction-dependent information on how a free field sound source reaches the ear [32,33].…”

Section: Spatial Audio Renderingmentioning

confidence: 99%

Measuring the Behavioral Response to Spatial Audio within a Multi-Modal Virtual Reality Environment in Children with Autism Spectrum Disorder

2019

View full text Add to dashboard Cite

Virtual Reality (VR) has been an active area of research in the development of interactive interventions for individuals with autism spectrum disorder (ASD) for over two decades. These immersive environments create a safe platform in which therapy can address the core symptoms associated with this condition. Recent advancements in spatial audio rendering techniques for VR now allow for the creation of realistic audio environments that accurately match their visual counterparts. However, reported auditory processing impairments associated with autism may affect how an individual interacts with their virtual therapy application. This study aims to investigate if these difficulties in processing audio information would directly impact how individuals with autism interact with a presented virtual spatial audio environment. Two experiments were conducted with participants diagnosed with ASD (n = 29) that compared: (1) behavioral reaction between spatialized and non-spatialized audio; and (2) the effect of background noise on participant interaction. Participants listening to binaural-based spatial audio showed higher spatial attention towards target auditory events. In addition, the amount of competing background audio was reported to influence spatial attention and interaction. These findings suggest that despite associated sensory processing difficulties, those with ASD can correctly decode the auditory cues simulated in current spatial audio rendering techniques.

show abstract

Auditory-Induced Presence in Mixed Reality Environments and Related Technology

Cited by 49 publications

References 26 publications

Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality

Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality

Designing presence for real locomotion in immersive virtual environments: an affordance-based experiential approach

Measuring the Behavioral Response to Spatial Audio within a Multi-Modal Virtual Reality Environment in Children with Autism Spectrum Disorder

Contact Info

Product

Resources

About