Interaction between auditory and visual perceptions on distance estimations in a virtual environment

Abstract

International audienceNavigation in virtual environments relies on an accurate spatial rendering. A virtual object is localized according to its position in the environment, which is usually defined by the following three coordinates: azimuth, elevation and distance. Even though several studies investigated the perception of auditory and visual cues in azimuth and elevation, little has been made on the distance dimension. This study aims at investigating the way humans estimate visual and auditory egocentric distances of virtual objects. Subjects were asked to estimate the egocentric distance of 2–20 m distant objects in three contexts: auditory perception alone, visual one alone, combination of both perceptions (with coherent and incoherent visual and auditory cues). Even though egocentric distance was under-estimated in all contexts, the results showed a higher influence of visual information than auditory information on the perceived distance. Specifically, the bimodal incoherent condition gave perceived distances equivalent to those in the visual-only condition only when the visual target was closer to the subject than the auditory target

Effect of auditory and visual stimuli on distance perception presented by head-mounted display and headphone

“…On the other hand, the estimated results of the distance in Refs. [8] and [10] are additionally shown in the figure. In these studies, the egocentric distances between their position and the target objects (loudspeaker) were evaluated, which are located in a corridor space [8] or on the stage of a concert hall [10].…”

“…[8] and [10] are additionally shown in the figure. In these studies, the egocentric distances between their position and the target objects (loudspeaker) were evaluated, which are located in a corridor space [8] or on the stage of a concert hall [10]. It should be noted that the visual stimuli were presented on the visual display of a stereoscopic screen [8] or a large flat screen HDTV [10].…”

“…Herein, the obtained results in the Refs. [8] and [10] are also shown in the figure by black solid and broken lines, respectively. The Ref.…”

“…As can be seen in these investigations, the distance perception has been the subject of interest from the viewpoints of auditory or visual perception, however multiple effect of the auditory and visual perception on the distance perception has not been much investigated. Although subjective influences of the auditory and/or visual stimuli on the distance perception are investigated [8], only speech sounds were convolved with simulated impulse responses and used as auditory stimuli. The subjective effect of the visual and auditory stimuli including more impulsive sounds largely influenced by the reverberation of the spaces should be comparatively investigated together with such quasi-stationary sounds like speeches.…”

Research on Optimization Method of VR Task Scenario Resources Driven by User Cognitive Needs

“…Li Yang [6] et al designed badminton experimental scenes under VR conditions and added seven modal clues to study the influence of multi-channels on moving target selection performance and subjective feelings. Paquier Mathieu [7] et al discussed the self-centered distance perception method of users under the alternation of visual and auditory peaks of virtual objects in distance dimension. Lei Xiao [8] et al summarized the use of tactile clues to interact with other sensory stimuli to predict potential perceptual experiences in multi-sensory environments.…”