Quantifying fidelity for virtual environment simulations employing memory schema assumptions

Mourkoussis, Nicholaos; Rivera, Fiona; Trościanko, Tom; Dixon, Timothy D.; Hawkes, Rycharde; Mania, Katerina

doi:10.1145/1857893.1857895

Cited by 26 publications

(16 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Graphical fidelity commonly refers to polygon count (the number of triangles that comprise a surface), or texture resolution (excellent overviews are provided by Provost [12], Guo et al, [13], and Rubino and Power [14]). Polygon count was studied in relation to visual cognition by Mourkoussis et al [15] and with respect to memory, they found that as long as the scene was relatively realistic, the level of visual realism had no effects on high-level cognition.…”

Section: B Real-time Rendering Of Audio-visual Environmentsmentioning

confidence: 99%

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Rojas

Kapralos

Hogue

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

Visual and auditory cues are important facilitators of user engagement in virtual environments and video games. Prior research supports the notion that our perception of visual fidelity (quality) is influenced by auditory stimuli. Understanding exactly how our perception of visual fidelity changes in the presence of multimodal stimuli can potentially impact the design of virtual environments, thus creating more engaging virtual worlds and scenarios. Stereoscopic 3-D display technology provides the users with additional visual information (depth into and out of the screen plane). There have been relatively few studies that have investigated the impact that auditory stimuli have on our perception of visual fidelity in the presence of stereoscopic 3-D. Building on previous work, we examine the effect of auditory stimuli on our perception of visual fidelity within a stereoscopic 3-D environment.

show abstract

Section: B Real-time Rendering Of Audio-visual Environmentsmentioning

confidence: 99%

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Rojas

Kapralos

Hogue

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

show abstract

“…Moreover, sophisticated selective rendering algorithms will be implemented based on previous work on schema frameworks [7] in order to guide rendering detail in perceptually important aspects of the scene. Moreover, fMRI studies utilizing the lighting rendering system will be conducted at the Brighton and Sussex Medical School utilizing participants from the normal population as well as ultimately include depersonalization syndrome patients We intend to use this approach to examine the phenomenon of 'depersonalization-derealization' (DP-DR).…”

Section: Experiments 2: Exploring the Effect Of Lightingmentioning

confidence: 99%

“…The well-known work of Land and his colleagues on making a cup of tea, driving, or playing music, suggests that vision is used to guide action on a "just in time" basis, and that very few fixations are made to task-irrelevant locations in the scene [1]. However, this work does not allow us to say how such processes would be impaired if the quality of the scene (either its resolution or its temporal properties) was to be altered or somehow impaired or what happens when we are dealing with a computer graphics simulation for training [7]. Moreover, we lack knowledge of how different scenes, and observers with different internal states or perspective, would modify the relative importance of different aspects of the scene.…”

mentioning

confidence: 99%

Exploring Behavioural Fidelity of Synthetic Stimuli While Immersed in fMRI Displays

Mania

Medford

Christodoulou

et al. 2011

2011 Third International Conference on Games and Virtual Worlds for Serious Applications

Self Cite

View full text Add to dashboard Cite

The goal of the proposed experiments is to assess the fidelity of a simulation as well as develop synthetic imaging systems which will result in controlled functional Magnetic Resonance Imaging (fMRI) experiments involving the normal population as well as patients. The ultimate goal of the experiments planned is to explore whether natural and artificial scenes of varied fidelity for training or for therapeutic purposes engage common perceptual or neuroscientific mechanisms. Such input is non-obtrusive and is derived at the same time as the experience occurs. The first experiment briefly summarized is exploring brain empathic responses of users participating in an interactive economic game developed to be displayed in a fMRI scanner. The second experiment presents an interactive lighting system also to be displayed in an fMRI scanner. Its scope is to enable the monitoring of neural activation patterns in response to lighting manipulations ranging from daylight and artificial light of the normal population initially and potentially of groups of patients suffering from the depersonalization syndrome. A broader aim of this work is to assess whether such powerful socialpsychological studies could be usefully carried out within Virtual Environments advancing both cognitive neuroscience and computer graphics research. Keywords-computer graphics simulations; perceptuallybased rendering; fidelity metrics; cognitive neuroscience I. SCOPEVirtual environment (VE) and Simulation technology is an advancing medium that allows its users to interact with computer-generated three-dimensional worlds. These worlds could be displayed on a typical desktop monitor or onto more sophisticated immersive displays such as Head Mounted Displays (HMDs) or even functional Magnetic Resonance Imaging (fMRI) scanners. What sets VE technology apart from its ancestors is that in VE systems for simulation and training users receive multi-sensory stimuli which respond to their reactions (for instance, using head tracking) and are intended to provide a sensation of natural interaction with the synthetic world, aiming at positive transfer of training in real-world, often hazardous, task situation such training in a flight simulator. While there has been extensive work to enhance the perceptual realism of VEs and graphic displays, it is never clear to what extent such improvements in visual quality are associated with differences in visual cognition of the trainees. For example, recent computer graphics technology allows very high quality graphics to be produced -but how much could the quality be reduced without consequent changes in the cognitive processes in the human observer? This may depend on the importance of the subset of the scene and its scope which drives human perception at that instant. Thus, for example, the eyes of a synthetic character are important in revealing their owner's intentions and are therefore in need of high-quality rendering. One of the purposes of the proposed work is to understand how the brain processes perceptually impor...

show abstract

“…While there has been extensive work to enhance the perceptual realism of VEs and graphic displays, it is never clear to what extent such improvements in visual quality are associated with differences in visual cognition of the trainees (Mourkoussis et al, 2010). Recent computer graphics technology allows high quality graphics to be produced -but how International Journal of Interactive Worlds 2 much could the quality be reduced without consequent changes in the cognitive processes in the human observer?…”

Section: Introductionmentioning

confidence: 99%

“…The well-known work of Land and his colleagues on making a cup of tea, driving, or playing music, suggests that vision is used to guide action on a "just in time" basis, and that very few fixations are made to task-irrelevant locations in the scene (Land et al, 1998). However, this work does not allow the researchers to say how such processes would be impaired if the quality of the scene (either its resolution or its temporal properties) was to be altered or somehow impaired or how close a simulation for training is to the real-world task situation simulated (Mourkoussis et al, 2010;Mania et al, 2006). Moreover, the researchers lack knowledge of how different scenes, and observers with different internal states or perspective, would be affected by the relative importance of different aspects of the scene.…”

Section: Introductionmentioning

confidence: 99%

A 3D Lighting System for fMRI Rendering Fidelity Experiments

Christodoulou¹,

Radulescu²,

Medford³

et al. 2013

IJIW

Self Cite

View full text Add to dashboard Cite

Although improvements in basic computer graphics rendering hardware and lighting algorithms have produced some remarkable results, it is still computationally demanding to render a highly realistic Virtual Environment (VE) in real-time. This paper presents a real-time synthetic lighting system incorporating sophisticated global illumination algorithms aiming to induce similar subjective lighting impressions as in the real world. The lighting system proposed is designed to render an interactive VE on an fMRI display, enabling the conduct of formal neuroscientific experiments and investigating the effects of visual fidelity as well as varied lighting configurations on feelings of presence, 'reality' and comfort. Ultimately, the goal is to use this system to explore the effect of lighting variations (daylight vs. forms of artificial light) on subjective impressions of a group of patients suffering from the 'depersonalization' syndrome. The system was developed in close collaboration with the Brighton and Sussex Medical School in the UK. It was a challenge to develop an interactive lighting system to be utilized for fMRI experimentation due to infrastructural and technical demands. Such demands were based on acquiring user input when immersed in the constrained environment of an fMRI scanner while the system reacts to it in real-time. fMRI experiments usually employ simple display material, for example using photographs, video clips or simple computerized stimuli. Employing VEs in fMRI has the advantage that it is possible to involve participants in interactive animated environments which more realistically reflect social and emotional situations.

show abstract

Quantifying fidelity for virtual environment simulations employing memory schema assumptions

Cited by 26 publications

References 24 publications

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

The Effect of Sound on Visual Fidelity Perception in Stereoscopic 3-D

Exploring Behavioural Fidelity of Synthetic Stimuli While Immersed in fMRI Displays

A 3D Lighting System for fMRI Rendering Fidelity Experiments

Contact Info

Product

Resources

About