Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli

Lewald, Jörg; Guski, Rainer

doi:10.1016/s0926-6410(03)00074-0

Cited by 181 publications

(173 citation statements)

References 72 publications

Supporting

Mentioning

150

Contrasting

Order By: Relevance

“…The dominance of vision in ventriloquism is compatible with vision usually being the least variable sense in specifying spatial location [22,33]. Conversely, audition has been shown to be more reliable than vision in determining the temporal aspects of a stimulus [22,32,33] and when the components of a multisensory stimulus are separated in time, the perceived timing of the visual component is shifted towards that of the sound [2,5,7,15,18,22,23,[29][30][31].…”

mentioning

confidence: 81%

“…When auditory and visual stimuli are spatially congruent, temporal integration is greatest when the onset of the visual stimulus occurs before the onset of the auditory stimulus [2,5,7,15,18,22,23,[29][30][31]. The visual stimulus then appears shifted in time towards the temporal location of the auditory stimulus provided the SOA is less than about 220 ms [7,15,18,25,31].…”

mentioning

confidence: 99%

See 1 more Smart Citation

Auditory–visual temporal integration measured by shifts in perceived temporal location

Jaekl

Harris

2007

Neuroscience Letters

View full text Add to dashboard Cite

The perceived time of occurrence of a visual stimulus may be shifted towards the onset of an auditory stimulus occurring a short time later. The effect has been attributed to auditory-visual temporal integration although an unknown portion of the shift may be explained by the different processing times of visual and auditory stimuli. Here, perceived onset time is measured in a novel way that separates and compares the magnitude of these effects. Participants observed either a sequence consisting of a visual stimulus followed by an auditory stimulus and then another visual stimulus or the reverse. The temporal location of the second stimulus was varied systematically between the onset of the first and third stimuli, which were separated by a fixed duration. Two timescales were used: a short timescale that allowed for auditory-visual temporal integration to occur, and a long timescale that did not. Psychometric curves were fitted for both timescales, to the percentage the first interval was perceived is shortest, as a function of first interval duration. For the long timescale condition the point of subjective equality (PSE) of the two interval lengths was consistent with the different processing latencies. When visual and auditory stimuli occurred within 125 ms significant additional shifting of the PSE occurred. These results indicate that temporal integration shifts the perceived timing of a visual stimulus by an amount much larger than can be explained differential processing latencies.

show abstract

mentioning

confidence: 81%

mentioning

confidence: 99%

Auditory–visual temporal integration measured by shifts in perceived temporal location

Jaekl

Harris

2007

Neuroscience Letters

View full text Add to dashboard Cite

show abstract

“…Surprisingly, however, this is not usually the case. For audio-visual stimuli, the PSS is usually shifted toward a visual-lead stimulus, which means that simultaneity is maximally perceived if vision comes slightly before hearing (e.g., Kayser, Petkov, & Logothetis, 2008;Lewald & Guski, 2003;Lewkowicz, 1996;Slutsky & Recanzone, 2001;Zampini, Guest, Shore, & Spence, 2005;Zampini, Shore, & Spence, 2003asee Figure 1). Moreover, the raw data of an SJ or TOJ task are usually not mirror symmetric around the PSS but are skewed toward more "simul- In the TOJ task, participants judge which stimulus came first, whereas in the SJ task, they judge whether stimuli were simultaneous or successive.…”

Section: When Is Simultaneous?mentioning

confidence: 99%

Perception of intersensory synchrony: A tutorial review

Vroomen

Keetels

2010

Attention, Perception, & Psychophysics

394

390

View full text Add to dashboard Cite

“…From the literature, it appears that they are quite different. For spatial ventriloquism, several behavioral and physiological studies have shown that the spatial ventriloquist effect disappears when the audiovisual temporal alignment is outside a −100 -+ 300 ms window (−100 ms = sound before vision; +300 ms=sound after vision), while the horizontal spatial alignment should not exceed~15° (Godfroy et al, 2003;Hairston, Wallace, Vaughan, Stein, Norris & Schirillo, 2003;Lewald & Guski, 2003;Slutsky & Recanzone, 2001;Radeau & Bertelson, 1977), although the specific degree of tolerated disparities could take a wide range (Wallace, Roberson, Hairston, Stein, Vaughan & Schirillo, 2004).…”

Section: Spatial and Temporal Criteria For Intersensory Pairingmentioning

confidence: 99%

Intersensory binding across space and time: A tutorial review

Chen

Vroomen

2013

Atten Percept Psychophys

207

180

View full text Add to dashboard Cite

Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism-such as attention, synesthetic correspondence, and other cognitive factors-are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.

show abstract

Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli

Cited by 181 publications

References 72 publications

Auditory–visual temporal integration measured by shifts in perceived temporal location

Auditory–visual temporal integration measured by shifts in perceived temporal location

Perception of intersensory synchrony: A tutorial review

Intersensory binding across space and time: A tutorial review

Contact Info

Product

Resources

About