In the past decade, there has been a rapid advance in Virtual Reality (VR) technology. Key to the user’s VR experience are multimodal interactions involving all senses. The human brain must integrate real-time vision, hearing, vestibular and proprioceptive inputs to produce the compelling and captivating feeling of immersion in a VR environment. A serious problem with VR is that users may develop symptoms similar to motion sickness, a malady called cybersickness. At present the underlying cause of cybersickness is not yet fully understood. Cybersickness may be due to a discrepancy between the sensory signals which provide information about the body’s orientation and motion: in many VR applications, optic flow elicits an illusory sensation of motion which tells users that they are moving in a certain direction with certain acceleration. However, since users are not actually moving, their proprioceptive and vestibular organs provide no cues of self-motion. These conflicting signals may lead to sensory discrepancies and eventually cybersickness. Here we review the current literature to develop a conceptual scheme for understanding the neural mechanisms of cybersickness. We discuss an approach to cybersickness based on sensory cue integration, focusing on the dynamic re-weighting of visual and vestibular signals for self-motion.

Older adults struggle in dealing with changeable and uncertain environments across several cognitive domains. This has been attributed to difficulties in forming adequate task representations that help navigate uncertain environments. Here, we investigate how, in older adults, inadequate task representations impact on model-based reversal learning. We combined computational modeling and pupillometry during a novel model-based reversal learning task, which allowed us to isolate the relevance of task representations at feedback evaluation. We find that older adults overestimate the changeability of task states and consequently are less able to converge on unequivocal task representations through learning. Pupillometric measures and behavioral data show that these unreliable task representations in older adults manifest as a reduced ability to focus on feedback that is relevant for updating task representations, and as a reduced metacognitive awareness in the accuracy of their actions. Instead, the data suggested older adults' choice behavior was more consistent with a guidance by uninformative feedback properties such as outcome valence. Our study highlights that an inability to form adequate task representations may be a crucial factor underlying older adults' impaired model-based inference.

The perceptibility of subjective contour in a two-dimensional configuration is shown to vary systematically with the magnitude of simultaneous brightness contrast. Since prior work had suggested depth cues as the basis for subjective contour, depth cues were maintained in all configurations. However, depth cues failed to sustain the perception of subjective contour with a reduction in simultaneous brightness contrast.

The popularity of virtual reality (VR) has increased rapidly in recent years. While significant technological advancements are apparent, a troublesome problem with VR is that between 20% and 80% of users will experience unpleasant side effects such as nausea, disorientation, blurred vision and headaches—a malady known as Cybersickness. Cybersickness may be caused by a conflict between sensory signals for self‐motion: while vision signals that the user is moving in a certain direction with certain acceleration, the vestibular organs provide no corroborating information. To resolve the sensory conflict, vestibular cues may be down‐weighted leading to an alteration of how the brain interprets actual vestibular information. This may account for the frequently reported after‐effects of VR exposure. Here, we investigated whether exposure to vection in VR modulates vestibular processing. We measured vestibular‐evoked myogenic potentials (VEMPs) during brief immersion in a vection‐inducing VR environment presented via head‐mounted display. We found changes in VEMP asymmetry ratio, with a substantial increase in VEMP amplitude recorded on the left sternocleidomastoid muscle following just one minute of exposure to vection in VR. Our results suggest that exposure to vection in VR modulates vestibular processing, which may explain common after‐effects of VR.

During exposure to Virtual Reality (VR) a sensory conflict may be present, whereby the visual system signals that the user is moving in a certain direction with a certain acceleration, while the vestibular system signals that the user is stationary. In order to reduce this conflict, the brain may down-weight vestibular signals, which may in turn affect vestibular contributions to self-motion perception. Here we investigated whether vestibular perceptual sensitivity is affected by VR exposure. Participants’ ability to detect artificial vestibular inputs was measured during optic flow or random motion stimuli on a VR head-mounted display. Sensitivity to vestibular signals was significantly reduced when optic flow stimuli were presented, but importantly this was only the case when both visual and vestibular cues conveyed information on the same plane of self-motion. Our results suggest that the brain dynamically adjusts the weight given to incoming sensory cues for self-motion in VR; however this is dependent on the congruency of visual and vestibular cues.

No abstract

On Earth, we are continually exposed to gravity: sensory signals are constantly integrated to form an internal model of gravity. However, it is unclear whether this internal model is fixed to Earth’s gravity or whether it can be applied to a new gravitational environment. Under terrestrial gravity, observers show a “gravitational bias” while judging the speed of falling versus rising objects, as they comply with the physical laws of gravity. We investigated whether this gravitational bias may be present when judging the speed of objects moving upwards or downwards in both virtual reality (VR)-simulated Earth gravity (9.81 m/s2) and Mars gravity (3.71 m/s2). Our results highlighted a gravitational bias in both Earth and Mars VR-simulated gravity: the speed of downwards movement was more precisely detected than the speed of upwards movement. Although the internal model of gravity has been built up under terrestrial gravity, it can quickly expand to novel non-terrestrial gravitational environments.

The body midline provides a basic reference for egocentric representation of external space. Clinical observations have suggested that vestibular information underpins egocentric representations. Here we aimed to clarify whether and how vestibular inputs contribute to egocentric representation in healthy volunteers. In a psychophysical task, participants were asked to judge whether visual stimuli were located to the left or to the right of their body midline. Artificial vestibular stimulation was applied to stimulate the vestibular organs. We found that artificial stimulation of the vestibular system biased body midline perception. Importantly, no effect was found on motor effector selection. We also ruled out additional explanations based on allocentric visual representations and on potential indirect effects caused by vestibular-driven movements of the eyes, head and body. Taken together our data suggest that vestibular information contributes to computation of egocentric representations by affecting the internal representation of the body midline.