Selective rendering in a multi-modal environment

Ramic, Belma; Chalmers, Alan; Hasic, Jasminka; Rizvić, Selma

doi:10.1145/2614348.2614369

Cited by 14 publications

(13 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Cross-modal effects refer to the impact on the perceptual experience of one sensory input that the presentation of an additional sensory input can have [19]. Previous work has demonstrated that cross-modal effects can be considerable to the extent that large amounts of detail of one sense may be ignored in the presence of other sensory inputs (see [18] and [20], and for a more recent summary see also [21]). …”

Section: Sound and Multimodal Interactionsmentioning

confidence: 99%

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Rojas

Kapralos

Hogue

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

Visual and auditory cues are important facilitators of user engagement in virtual environments and video games. Prior research supports the notion that our perception of visual fidelity (quality) is influenced by auditory stimuli. Understanding exactly how our perception of visual fidelity changes in the presence of multimodal stimuli can potentially impact the design of virtual environments, thus creating more engaging virtual worlds and scenarios. Stereoscopic 3-D display technology provides the users with additional visual information (depth into and out of the screen plane). There have been relatively few studies that have investigated the impact that auditory stimuli have on our perception of visual fidelity in the presence of stereoscopic 3-D. Building on previous work, we examine the effect of auditory stimuli on our perception of visual fidelity within a stereoscopic 3-D environment.

show abstract

Section: Sound and Multimodal Interactionsmentioning

confidence: 99%

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Rojas

Kapralos

Hogue

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

show abstract

“…In 2007, Ramic et al [2006] showed that smell, in their case perfume, can be used to direct a viewer's attention to the smell origin in the scene, a bowl of flowers. The area around the bowl of flowers was rendered at the highest quality, while it was possible to render the remainder of the scene at a much lower quality, and thus at a reduced computational cost, without the viewer being aware of this quality difference.…”

Section: Cross-modal Renderingmentioning

confidence: 99%

“…Knowledge of how our eyes might view a scene when more than one sense is present has been exploited in computer graphics to selectively render images at a computationally lower cost without the viewer being aware of any drop in perceived quality [Ramic et al 2006], [Mastoropoulou et al 2005a], [Ellis and Chalmers 2006]. Smell, or olfaction is a key human sense.…”

Section: Introductionmentioning

confidence: 99%

Cross-modal affects of smell on the real-time rendering of grass

Brkic

Chalmers

Boulanger

et al. 2009

Proceedings of the 25th Spring Conference on Computer Graphics

Self Cite

View full text Add to dashboard Cite

Smell is a key human sense which can significantly effect our perception of an environment. Although, typically not as developed as our other senses, the presence of a pleasant or unpleasant smell can alter the way we view a scene. Such a cross-modal effect can be substantial with parts of a scene literally going unnoticed as the smell dominates our senses. This paper investigates the crossmodal affect on the perception of the real-time animation of a field of grass in the presence of the smell of cut-grass. Rendering the high level of detail of a close-up view of a field of grass is computationally very demanding. In the real world the smell of grass would be present, and especially strong if the grass had just been cut, for example in preparation for a sports event. By exploiting the cross-modal interaction between smell and visuals we are able to render a lower quality version of a field of grass at a reduced computational cost, without the viewer being aware of the quality difference compared to a high quality version.

show abstract

“…Previous work [Ramic et al 2006;Brkic et al 2009] and a pilot study tested the perceived visual quality for each stimuli independently. The results showed that strong smell, high temperature and noise resulted in the lowest threshold for perceived visual quality.…”

Section: Methodsmentioning

confidence: 99%

Exploring multiple modalities for selective rendering of virtual environments

Ramić-Brkić

Chalmers

Sadzak

et al. 2013

Proceedings of the 29th Spring Conference on Computer Graphics

Self Cite

View full text Add to dashboard Cite

The cross-modal interaction between vision and other senses is a key part of how we perceive the real world. Significant stimulation to hearing, sense of smell, taste or touch can reduce the cognitive resources the brain is able to allocate to sight, and thus limit what the Human Visual System (HVS) can actually perceive at that moment. Selective rendering is able to exploit such knowledge of the HVS, to render those parts of a virtual environment a viewer is attending to at a high quality and the rest of the scene at a much lower quality, and thus at a substantially reduced rendering time, without the viewer being aware of this quality difference. This paper investigates how the presence of the modalities of sound, smell and ambient temperature in a virtual environment significantly affects a viewer's ability to perceive the quality of the graphics used for that environment. Experiments were run with a total of 356 participants to determine the graphics quality thresholds across the different cross-modal interactions. The results revealed a significant effect of strong perfume, high temperature and audio noise on perceived rendering quality. Under given conditions, this particular combination of modalities can be thus exploited when rendering virtual environments, to substantially reduce rendering time without any loss in the user's perception of delivered visual quality.

show abstract

Selective rendering in a multi-modal environment

Cited by 14 publications

References 8 publications

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Cross-modal affects of smell on the real-time rendering of grass

Exploring multiple modalities for selective rendering of virtual environments

Contact Info

Product

Resources

About