Distortions of perceived auditory and visual space following adaptation to motion

Deas, Ross W.; Roach, Neil W.; McGraw, Paul V.

doi:10.1007/s00221-008-1543-1

Cited by 17 publications

(11 citation statements)

References 74 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The effect of adaptation to a specific motion direction has been commonly observed in hMT+/V5 (He et al, 1998;Hogendoorn and Verstraten, 2013;Huk et al, 2001;Tootell et al, 1995;Van Wezel 2002). Similarly, behavioral studies have provided compelling evidence for motion selective (Deas et al, 2008;Guerreiro et al, 2016;Kitagawa and Ichihara, 2002;Reinhardt-Rutland and Anstis, 1982) and direction-sensitive auditory motion aftereffects (aMAEs) (Dong et al, 2000;Grantham, 1998;Grantham and Wightman, 1979;Neelon and Jenison, 2003).…”

Section: Does Hpt Contain Information About Specific Motion Directionmentioning

confidence: 88%

Representation of auditory motion directions and sound source locations in the human planum temporale

Battal

Rezk

Mattioni

et al. 2018

Preprint

View full text Add to dashboard Cite

The ability to precisely compute the location and direction of sounds in external space is a crucial perceptual process to efficiently interact with dynamic environments. Little is known, however, about how the human brain implements spatial hearing. In our study, we used fMRI to characterize the brain activity of humans listening to left, right, up and down moving as well as static sounds. Whole brain univariate results contrasting moving and static sounds varying in their location revealed a robust functional preference for auditory motion in bilateral human Planum Temporale (hPT). Importantly, multivariate pattern classification analysis showed that hPT contains information about both auditory motion directions and, to a lesser extent, sound source locations. More precisely, we observed that our classifier successfully decoded opposite axes of motion (vertical versus horizontal) but was less able to classify opposite within-axis direction (left versus right or up versus down); reminiscent of the axis of motion organization observed in the middle-temporal cortex for vision. Further multivariate analyses demonstrated that even if motion direction and location rely on partially shared pattern geometries in PT, the responses elicited by static and moving sounds were however highly distinct. Altogether our results demonstrate that human PT codes for auditory motion and location but that the underlying neural computation linked to motion processing is more reliable and partially distinct from the one supporting sound source location.All rights reserved. No reuse allowed without permission.

show abstract

Section: Does Hpt Contain Information About Specific Motion Directionmentioning

confidence: 88%

Representation of auditory motion directions and sound source locations in the human planum temporale

Battal

Rezk

Mattioni

et al. 2018

Preprint

View full text Add to dashboard Cite

show abstract

“…Auditory stimuli were convolved with observer’s individually recorded head-related transfer function (HRTF) representing the spatial offset selected for that trial (+10° or −10°) and presented at 70 dB SPL. This produced compelling auditory locations that were perceptually aligned with the spatial location of the corresponding visual stimulus (for details of the HRTF measurement process see Deas et al (2008)). The experiment was controlled by custom-written software in MatLab (Mathworks, USA) on a Dell desktop PC.…”

Section: Methodsmentioning

confidence: 99%

Audiovisual time perception is spatially specific

et al. 2012

Self Cite

View full text Add to dashboard Cite

Our sensory systems face a daily barrage of auditory and visual signals whose arrival times form a wide range of audiovisual asynchronies. These temporal relationships constitute an important metric for the nervous system when surmising which signals originate from common external events. Internal consistency is known to be aided by sensory adaptation: repeated exposure to consistent asynchrony brings perceived arrival times closer to simultaneity. However, given the diverse nature of our audiovisual environment, functionally useful adaptation would need to be constrained to signals that were generated together. In the current study, we investigate the role of two potential constraining factors: spatial and contextual correspondence. By employing an experimental design that allows independent control of both factors, we show that observers are able to simultaneously adapt to two opposing temporal relationships, provided they are segregated in space. No such recalibration was observed when spatial segregation was replaced by contextual stimulus features (in this case, pitch and spatial frequency). These effects provide support for dedicated asynchrony mechanisms that interact with spatially selective mechanisms early in visual and auditory sensory pathways.

show abstract

“…Auditory stimuli were 20 ms bursts of white noise (200 Hz—12 kHz passband, 5 ms cosine ramp at onset/offset), presented binaurally via Sennheiser HD-265 headphones. Auditory stimuli were convolved with a generic pair of head-related impulse response functions corresponding to a spatial position immediately in front of the observer (0° azimuth, 0° elevation; see [26] for measurement details).…”

Section: Methodsmentioning

confidence: 99%

Asynchrony adaptation reveals neural population code for audio-visual timing

et al. 2010

Self Cite

View full text Add to dashboard Cite

The relative timing of auditory and visual stimuli is a critical cue for determining whether sensory signals relate to a common source and for making inferences about causality. However, the way in which the brain represents temporal relationships remains poorly understood. Recent studies indicate that our perception of multisensory timing is flexible—adaptation to a regular inter-modal delay alters the point at which subsequent stimuli are judged to be simultaneous. Here, we measure the effect of audio-visual asynchrony adaptation on the perception of a wide range of sub-second temporal relationships. We find distinctive patterns of induced biases that are inconsistent with the previous explanations based on changes in perceptual latency. Instead, our results can be well accounted for by a neural population coding model in which: (i) relative audio-visual timing is represented by the distributed activity across a relatively small number of neurons tuned to different delays; (ii) the algorithm for reading out this population code is efficient, but subject to biases owing to under-sampling; and (iii) the effect of adaptation is to modify neuronal response gain. These results suggest that multisensory timing information is represented by a dedicated population code and that shifts in perceived simultaneity following asynchrony adaptation arise from analogous neural processes to well-known perceptual after-effects.

show abstract

Distortions of perceived auditory and visual space following adaptation to motion

Cited by 17 publications

References 74 publications

Representation of auditory motion directions and sound source locations in the human planum temporale

Representation of auditory motion directions and sound source locations in the human planum temporale

Audiovisual time perception is spatially specific

Asynchrony adaptation reveals neural population code for audio-visual timing

Contact Info

Product

Resources

About