Using a Multimodal Immersive Environment to Investigate Perceptions in Augmented Virtual Reality Systems

Abstract

The Collaborative-Research Augmented Immersive Virtual Environment Laboratory at Rensselaer is a state-of-the-art space that offers users the capabilities of multimodality and immersion. Realistic and abstract sets of data can be explored in a variety of ways, even in large group settings. This paper discusses the motivations of the immersive experience and the advantages over smaller scale and single-modality expressions of data. One experiment focuss on the influence of immersion on perceptions of architectural renderings. Its findings suggest disparities between participants’ judgment when viewing either two-dimensional printouts or the immersive CRAIVE-Lab screen. The advantages of multimodality are discussed in an experiment concerning abstract data exploration. Various auditory cues for aiding in visual data extraction were tested for their affects on participants’ speed and accuracy of information extraction. Finally, artificially generated auralizations are paired with recreations of realistic spaces to analyze the influences of immersive visuals on the perceptions of sound fields. One utilized method for creating these sound fields is a geometric ray-tracing model, which calculates the auditory streams of each individual loudspeaker in the lab to create a cohesive sound field representation of the visual space.

From immersion to collaborative embodiment: extending collective interactivity in built environments through human-scale audiovisual immersive technologies

“…Visual information extraction in the immersant space has been used to facilitate perceptual studies on other senses, such as auditory cue retrieval (Lee, Chabot, and Braasch 2017) and the effects of human-scale presentation of architectural renderings on design judgments (Elder 2017). Results in the former experiment discuss the importance of auditory localization on speed and accuracy of extraction, while results in the latter indicate discrepancies in judgments between traditional architectural and humanscale presentations of designs (Chabot et al 2018). These experiments reinforce the salience of cross-modal perception in a human-scale, immersive context.…”

The Influence of Perceived Spiciness on Actual Taste Experience: An Experimental Study

“…The influence of information on consumer evaluations has been studied using Check-All-That-Apply questions and sorting, with a case study on milk desserts showing that information had a small impact on overall liking scores and product characterizations [16]. Lastly, a study on the immediate effects of Vagus Nerve Stimulation on sensory processing provided insights into the rapid regulation of sensory processing [17].…”

The Influence of Perceived Spiciness on Actual Taste Experience: An Experimental Study

“…The influence of information on consumer evaluations has been studied using Check-All-That-Apply questions and sorting, with a case study on milk desserts showing that information had a small impact on overall liking scores and product characterizations [16]. Lastly, a study on the immediate effects of Vagus Nerve Stimulation on sensory processing provided insights into the rapid regulation of sensory processing [17].…”