A Cross-Modal Aftereffect: Auditory Displacement following Adaptation to Visual Motion

Ehrenstein, Walter H.; Reinhardt-Rutland, Anthony

doi:10.2466/pms.1996.82.1.23

Cited by 24 publications

(14 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The demonstration of an auditory aftereffect following adaptation to visual motion is consistent with previous findings from Kitagawa and Ichihara (2002) and Ehrenstein and Reinhardt-Rutland (1996). Kitagawa and Ichihara examined the effect of adapting to auditory and visual stimuli, moving in depth, on stationary test stimuli.…”

Section: Methodssupporting

confidence: 86%

Distortions of perceived auditory and visual space following adaptation to motion

2008

View full text Add to dashboard Cite

Adaptation to visual motion can induce marked distortions of the perceived spatial location of subsequently viewed stationary objects. These positional shifts are direction specific and exhibit tuning for the speed of the adapting stimulus. In this study, we sought to establish whether comparable motion-induced distortions of space can be induced in the auditory domain. Using individually measured head related transfer functions (HRTFs) we created auditory stimuli that moved either leftward or rightward in the horizontal plane. Participants adapted to unidirectional auditory motion presented at a range of speeds and then judged the spatial location of a brief stationary test stimulus. All participants displayed direction-dependent and speed-tuned shifts in perceived auditory position relative to a 'no adaptation' baseline measure. To permit direct comparison between effects in different sensory domains, measurements of visual motion-induced distortions of perceived position were also made using stimuli equated in positional sensitivity for each participant. Both the overall magnitude of the observed positional shifts, and the nature of their tuning with respect to adaptor speed were similar in each case. A third experiment was carried out where participants adapted to visual motion prior to making auditory position judgements. Similar to the previous experiments, shifts in the direction opposite to that of the adapting motion were observed. These results add to a growing body of evidence suggesting that the neural mechanisms that encode visual and auditory motion are more similar than previously thought.

show abstract

Section: Methodssupporting

confidence: 86%

Distortions of perceived auditory and visual space following adaptation to motion

2008

View full text Add to dashboard Cite

show abstract

“…In humans, most research work on multisensory integration is still at the stage of demonstrating the phenomenon and understanding the operative factors at perceptual and behavioral levels (for review, see O'Hare, 1991;Welch & Warren, 1986). Most frequently investigated are the aspects related to intersensory bias, that is, the capacity of a sensory system to modify-enhance, degrade-the perception from another system (e.g., Bernstein, 1970;Hershenson, 1962;Hubbard, 1966;McGurk & MacDonald, 1976;O'Leary & Rhodes, 1984;Sekuler, Sekuler, & Lau, 1997) and the relationships between this bias and multimodal spatial processing (how the sensory signals compete with one another according to the relative spatial position of the unimodal cues) (Bertelson & Radeau, 1981;Ehrenstein & Reinhardt-Rutland, 1996;Fisher & Pylyshyn, 1994;Frens, Vanopstal, & Vanderwilligen, 1995;Held, 1955;Pick, Warren, & Hay, 1969;Shelton & Searle, 1980;Stein, Meredith, Huneycutt, & McDade, 1989;Warren, McCarthy, & Welch, 1983) or the relationships between intersensory bias and the subject's attentional focus (Bernstein, 1970;Miller, 1982Miller, , 1986Spence & Driver, 1997). In these investigations, the tasks have been most often to detect, localize, and/or react to stimuli containing cues from one or more sensory modalities.…”

Section: Introductionmentioning

confidence: 99%

Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

Giard

Péronnet

1999

Journal of Cognitive Neuroscience

959

115

763

View full text Add to dashboard Cite

The aim of this study was (1) to provide behavioral evidence for multimodal feature integration in an object recognition task in humans and (2) to characterize the processing stages and the neural structures where multisensory interactions take place. Event-related potentials (ERPs) were recorded from 30 scalp electrodes while subjects performed a forced-choice reaction-time categorization task: At each trial, the subjects had to indicate which of two objects was presented by pressing one of two keys. The two objects were defined by auditory features alone, visual features alone, or the combination of auditory and visual features. Subjects were more accurate and rapid at identifying multimodal than unimodal objects. Spatiotemporal analysis of ERPs and scalp current densities revealed several auditory-visual interaction components temporally, spatially, and functionally distinct before 200 msec poststimulus. The effects observed were (1) in visual areas, new neural activities (as early as 40 msec poststimulus) and modulation (amplitude decrease) of the N185 wave to unimodal visual stimulus, (2) in the auditory cortex, modulation (amplitude increase) of subcomponents of the unimodal auditory N1 wave around 90 to 110 msec, and (3) new neural activity over the right fronto-temporal area (140 to 165 msec). Furthermore, when the subjects were separated into two groups according to their dominant modality to perform the task in unimodal conditions (shortest reaction time criteria), the integration effects were found to be similar for the two groups over the nonspecific fronto-temporal areas, but they clearly differed in the sensory-specific cortices, affecting predominantly the sensory areas of the nondominant modality. Taken together, the results indicate that multisensory integration is mediated by flexible, highly adaptive physiological processes that can take place very early in the sensory processing chain and operate in both sensory-specific and nonspecific cortical structures in different ways.

show abstract

“…In everyday life, we perceive a real object by hearing as well as seeing and touching. Several studies have shown that self-motion information systematically biases auditory spatial perception, such as the localisation or lateralisation of a sound (Clark and Graybiel 1949;Cullen et al 1992;Ehrenstein and Reinhardt-Rutland 1996;Thurlow and Kerr 1970). However, in no study has the effect of self-motion information on temporal aspects such as perceived temporal order of auditory events been investigated.…”

mentioning

confidence: 99%

Change of Temporal-Order Judgment of Sounds during Long-Lasting Exposure to Large-Field Visual Motion

Teramoto

Watanabe²,

Umemura³

et al. 2008

Perception

View full text Add to dashboard Cite

The perceived temporal order of external successive events does not always follow their physical temporal order. We examined the contribution of self-motion mechanisms in the perception of temporal order in the auditory modality. We measured perceptual biases in the judgment of the temporal order of two short sounds presented successively, while participants experienced visually induced self-motion (yaw-axis circular vection) elicited by viewing long-lasting large-field visual motion. In experiment 1, a pair of white-noise patterns was presented to participants at various stimulus-onset asynchronies through headphones, while they experienced visually induced self-motion. Perceived temporal order of auditory events was modulated by the direction of the visual motion (or self-motion). Specifically, the sound presented to the ear in the direction opposite to the visual motion (ie heading direction) was perceived prior to the sound presented to the ear in the same direction. Experiments 2A and 2B were designed to reduce the contributions of decisional and/or response processes. In experiment 2A, the directional cueing of the background (left or right) and the response dimension (high pitch or low pitch) were not spatially associated. In experiment 2B, participants were additionally asked to report which of the two sounds was perceived 'second'. Almost the same results as in experiment 1 were observed, suggesting that the change in temporal order of auditory events during large-field visual motion reflects a change in perceptual processing. Experiment 3 showed that the biases in the temporal-order judgments of auditory events were caused by concurrent actual self-motion with a rotatory chair. In experiment 4, using a small display, we showed that 'pure' long exposure to visual motion without the sensation of self-motion was not responsible for this phenomenon. These results are consistent with previous studies reporting a change in the perceived temporal order of visual or tactile events depending on the direction of self-motion. Hence, large-field induced (ie optic flow) self-motion can affect the temporal order of successive external events across various modalities.

show abstract

A Cross-Modal Aftereffect: Auditory Displacement following Adaptation to Visual Motion

Cited by 24 publications

References 8 publications

Distortions of perceived auditory and visual space following adaptation to motion

Distortions of perceived auditory and visual space following adaptation to motion

Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

Change of Temporal-Order Judgment of Sounds during Long-Lasting Exposure to Large-Field Visual Motion

Contact Info

Product

Resources

About