Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge

Picinali, Lorenzo; Afonso, Amandine; Denis, Michel; Katz, Brian F. G.

doi:10.1016/j.ijhcs.2013.12.008

Cited by 104 publications

(65 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Additionally, the sonification of objects and environments in AR/VR set-ups could be key to allow utilization of such technology by individuals with visual or tactile impairment. There have been promising results associated with the use of auditory cues to allow visually impaired individuals to experience 3D objects in AR (Ribeiro et al, 2012) and to create accurate spatial mental maps of an indoor environment using VR (i.e., not requiring an individual to be physically present in the environment) (Picinali et al, 2014).…”

Section: Conclusion and Directions For Future Researchmentioning

confidence: 99%

The Influence of Auditory Cues on Bodily and Movement Perception

Stanton

Spence

2020

Front. Psychol.

View full text Add to dashboard Cite

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues provide a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar crossmodal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior.

show abstract

Section: Conclusion and Directions For Future Researchmentioning

confidence: 99%

The Influence of Auditory Cues on Bodily and Movement Perception

Stanton

Spence

2020

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Moreover, past studies that compared binaural dummy head recordings to ambisonic speaker reproductions have displayed similar localization accuracy [39], and focused on user preference on musical tracks [40]. Despite preference of binaural artificial ear/head recordings (with [41] and without head-tracking [42]) over FOA-tracked binaural, it is still worthwhile to investigate FOA-tracked binaural because of recent improvements in ambisonic microphone quality and in the context of soundscape appraisals. It is thus timely to assess the perceptual differences between different FOA downmixed media for VR HMDs in evaluating outdoor sound scenes: static binaural (i.e.…”

Section: As Highlighted By Guastavino Et Al Audio Recording Techniqmentioning

confidence: 99%

Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications

Hong

Lam

Ong

et al. 2019

Building and Environment

View full text Add to dashboard Cite

With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Through subjective evaluations with 30 participants, the same participant evaluated four outdoor in situ locations vis-à-vis its corresponding audio-visual recording in VR on a separate day. A total of three spatial audio reproduction methods were assessed in VR, and they were all down-mixed from the first-order ambisonics (FOA) recordings to headphonebased FOA-static binaural, FOA-tracked binaural; and FOA 2-dimensional (2D) octagonal speaker array. The participants evaluated the acoustic environment in terms of the overall soundscape quality and perceived spatial qualities at each location. Regarding overall soundscape quality, there were no significant differences in evaluating the sound-source dominance and affective soundscape qualities between in situ and all VR methods. However, significant differences were found in the perceived spatial qualities between three reproduction methods and in situ. Among the source-related spatial attributes, the perceived distance of the dominating sounds was farther in the virtual than in the in situ evaluations. In the localization of sound sources, both the FOA-tracked binaural and the FOA-2D speaker array exhibited higher spatial acoustic fidelity than FOA-static binaural. Regarding the environment-related spatial quality attributes, the 2D speaker array reproduction was perceived as more immersive and realistic than other reproduction methods. Overall, the FOA-tracked binaural appears to exhibit sufficient fidelity for cinematic VR evaluation of soundscapes.

show abstract

“…Those who are newly blind due to disease or injury have a perception of spatial relationships and potential obstacles within an environment (Dulin & Hatwell, 2006); they have experienced the visual input of stepping off a curb or crossing a street. Those who are congenitally blind or impaired at a young age would develop these perceptions using their own spatial awareness and experiences; much of this is dependent upon their creativity, innovativeness, and other mental and cognitive skills (Maidenbaum et al, 2016;Picinali, Afonso, Denis, & Katz, 2014). Each of these spatial awareness perspectives can be supported by the VR design to help the visually impaired individual to develop O&M skills within the game environment such that the game adapts to the creativity and innovation level of the player to provide an appropriate environment to meet the needs and expectations of the user.…”

Section: Individual Differencesmentioning

confidence: 99%

Game design for visually-impaired individuals: Creativity and innovation theories and sensory substitution devices influence on virtual and physical navigation skills

Baker

Ramos

Turner

2018

telji

View full text Add to dashboard Cite

This action research study examined the design elements of three VR games that used an HTC VIVE VR helmet, two HTC game controllers, and a VR horse simulator for functionality and transferability to orientation and mobility (O&M) education for visually impaired individuals. The functionality of the VR games was tested with a visually-impaired individual based upon five characteristics that are important to O&M education: perimeter scanning then grid scanning, hearing, touch, smell, and perceptions of body positions. The horse simulator has potential benefits for proprioception and kinesthesia development. The inconsistent haptic feedback requires redesign consideration for inclusion within VR games and systems for O&M education of visually impaired individuals.

show abstract

Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge

Cited by 104 publications

References 43 publications

The Influence of Auditory Cues on Bodily and Movement Perception

The Influence of Auditory Cues on Bodily and Movement Perception

Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications

Game design for visually-impaired individuals: Creativity and innovation theories and sensory substitution devices influence on virtual and physical navigation skills

Contact Info

Product

Resources

About