Robust spatial ventriloquism effect and trial-by-trial aftereffect under memory interference

Park, Hame; Kayser, Christoph

doi:10.1038/s41598-020-77730-7

Cited by 11 publications

(29 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Equally well, a clearer head-centred advantage might have been apparent following shorter durations of adaptation than the shortest period included here (35 s). Indeed, rapid spatial recalibration effects have been reported following very short periods of adaptation of just a few seconds or even a single trial [12][13][14]. Testing shorter durations would require a radical redesign of our current paradigm, which relies on presenting repeated adapting stimuli across a range of azimuths before each test phase (35 seconds is the time required to complete one full sweep of all azimuths).…”

Section: Discussionmentioning

confidence: 99%

“…Similarly, spatial discrepancies between audio-visual stimuli induce a spatial recalibration such that the perception of auditory locations is biased in the direction of the visual offset [ 5 – 9 ]: the “ventriloquism aftereffect” (VAE). The VAE is observed following a diverse range of timescales of adaptation, from several minutes [ 4 , 7 , 10 , 11 ] down to just a few seconds or even a single stimulus presentation [ 12 – 14 ]. In a recent study we demonstrated that the VAE is underpinned by multiple recalibration mechanisms operating over different timescales, such that multiple VAEs at different temporal scales may be maintained simultaneously [ 15 ].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Multiple spatial reference frames underpin perceptual recalibration to audio-visual discrepancies

et al. 2021

View full text Add to dashboard Cite

In dynamic multisensory environments, the perceptual system corrects for discrepancies arising between modalities. For instance, in the ventriloquism aftereffect (VAE), spatial disparities introduced between visual and auditory stimuli lead to a perceptual recalibration of auditory space. Previous research has shown that the VAE is underpinned by multiple recalibration mechanisms tuned to different timescales, however it remains unclear whether these mechanisms use common or distinct spatial reference frames. Here we asked whether the VAE operates in eye- or head-centred reference frames across a range of adaptation timescales, from a few seconds to a few minutes. We developed a novel paradigm for selectively manipulating the contribution of eye- versus head-centred visual signals to the VAE by manipulating auditory locations relative to either the head orientation or the point of fixation. Consistent with previous research, we found both eye- and head-centred frames contributed to the VAE across all timescales. However, we found no evidence for an interaction between spatial reference frames and adaptation duration. Our results indicate that the VAE is underpinned by multiple spatial reference frames that are similarly leveraged by the underlying time-sensitive mechanisms.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Multiple spatial reference frames underpin perceptual recalibration to audio-visual discrepancies

et al. 2021

View full text Add to dashboard Cite

show abstract

“…31 healthy right-handed adults (10 males, mean age 25.5 years, range 19 - 37 years) participated in this study. Following previous studies using similar experimental protocols (Park et al, 2021; Park & Kayser, 2020, 2021) and recommendations for sample sizes in empirical psychology (Simmons et al, 2011) we aimed for a sample size of at least n=20. Of the 31 recruited participants, three had to be excluded as they did not follow the task instructions (localizing the visual rather than the auditory target in AV trials) and two exhibited a below-threshold spatial localization performance during a screening task (see below).…”

Section: Methodsmentioning

confidence: 99%

“…Visual stimuli were projected (Acer Predator Z650, Acer Inc., New Taipei City, Taiwan) onto an acoustically transparent screen placed in front of the speakers (Screen International Modigliani, 2×1 m 2 ). The visual stimulus was a cloud of white dots distributed according to a two-dimensional Gaussian distribution (200 dots, SD of vertical and horizontal spread = 1.6°, width of a single dot = 0.12°, duration = 50 ms), which has been used in previous studies on the ventriloquism effect and aftereffect (Park et al, 2021; Park & Kayser, 2020, 2021). The visual stimuli were centred around the same five locations as the acoustic stimuli (Figure 1B).…”

Section: Methodsmentioning

confidence: 99%

The context of experienced sensory discrepancies shapes multisensory integration and recalibration differently

Park

Kayser

2021

Preprint

Self Cite

View full text Add to dashboard Cite

Whether two sensory cues interact during perceptual judgments depends on their immediate properties, but as suggested by Bayesian models, also on the observer's a priori belief that these originate from a common source. While in many experiments this a priori belief is considered fixed, in real life it must adapt to the momentary context or environment. To understand the adaptive nature of human multisensory perception we investigated the context-sensitivity of spatial judgements in a ventriloquism paradigm. We exposed observers to audio-visual stimuli whose discrepancy either varied over a wider (±46°) or a narrower range (±26°) and hypothesized that exposure to a wider range of discrepancies would facilitate multisensory binding by increasing participants a priori belief about a common source for a given discrepancy. Our data support this hypothesis by revealing an enhanced integration (ventriloquism) bias in the wider context, which was echoed in Bayesian causal inference models fit to participants' data, which assigned a stronger a priori integration tendency during the wider context. Interestingly, the immediate ventriloquism aftereffect, a multisensory response bias obtained following a multisensory test trial, was not affected by the contextual manipulation, although participants' confidence in their spatial judgments differed between contexts for both integration and recalibration trials. These results highlight the context-sensitivity of multisensory binding and suggest that the immediate ventriloquism aftereffect is not a purely sensory-level consequence of the multisensory integration process.

show abstract

“…We argue that this is a minor concern for two reasons. First, a one-second difference is only small in relation to the duration of the judgment itself, which was about 6 s. Second, a recent study on audio-visual integration and recalibration has directly tested the effect of temporal delays and concluded that any potential influence of memory decay is small, at best (Park and Kayser 2020). Thus, the critical temporal offset that affects integration and recalibration should be the one between stimuli, not the one between stimuli and start of the judgment.…”

Section: Superposition Of Multiple Multisensory Attractionsmentioning

confidence: 99%

Visuo-proprioceptive integration and recalibration with multiple visual stimuli

Debats

Heuer

Kayser

2021

Preprint

Self Cite

View full text Add to dashboard Cite

To organize the plethora of sensory signals from our environment into a coherent percept, our brain relies on the processes of multisensory integration and sensory recalibration. We here asked how visuo-proprioceptive integration and recalibration are shaped by the presence of more than one potentially relevant visual stimulus, hence paving the way to studying multisensory perception under more naturalistic settings with multiple signals per sensory modality. By manipulating the spatio-temporal correspondence between the hand position and two visual stimuli during a cursor-control task, we contrasted two alternative accounts: that only the temporally more proximal signal enters integration and recalibration similar to a winner-takes-all process, or that the influences of both visual signals superpose. Our results show that integration - and likely also recalibration - are shaped by the superposed contributions of multiple stimuli rather than by only individual ones.

show abstract

Robust spatial ventriloquism effect and trial-by-trial aftereffect under memory interference

Cited by 11 publications

References 45 publications

Multiple spatial reference frames underpin perceptual recalibration to audio-visual discrepancies

Multiple spatial reference frames underpin perceptual recalibration to audio-visual discrepancies

The context of experienced sensory discrepancies shapes multisensory integration and recalibration differently

Visuo-proprioceptive integration and recalibration with multiple visual stimuli

Contact Info

Product

Resources

About