Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception

Lewald, Jörg; Guski, Rainer

doi:10.1016/j.neulet.2003.12.045

Cited by 75 publications

(74 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Importantly, these early effects of audio-visual integration are highly sensitive to asynchronies between the sensory signals (Sekuler et al, 1997;van der Burg, Olivers, et al, 2008). In order to compensate for offsets in stimulus processing as well as physical transfer times (Lewald & Guski, 2004), audio-visual integration during perceptual tasks tolerates small deviations from perfect synchrony (e.g., Vroomen & Keetels, 2010). Although this temporal window for audiovisual integration varies across different types of stimuli (e.g., Fujisaki, Shimojo, Kashino, & Nishida, 2004;van Wassenhove, et al, 2007), it typically does not exceed a few hundred milliseconds.…”

Section: Discussionmentioning

confidence: 99%

Semantic congruency but not temporal synchrony enhances long-term memory performance for audio-visual scenes

Meyerhoff

Huff

2015

Mem Cogn

View full text Add to dashboard Cite

Human long-term memory for visual objects and scenes is tremendous. Here, we test how auditory information contributes to long-term memory performance for realistic scenes. In a total of six experiments, we manipulated the presentation modality (auditory, visual, audio-visual) as well as semantic congruency and temporal synchrony between auditory and visual information of brief filmic clips. Our results show that audio-visual clips generally elicit more accurate memory performance than unimodal clips. This advantage even increases with congruent visual and auditory information. However, violations of audio-visual synchrony hardly have any influence on memory performance. Memory performance remained intact even with a sequential presentation of auditory and visual information, but finally declined when the matching tracks of one scene were presented separately with intervening tracks during learning. With respect to memory performance, our results therefore show that audio-visual integration is sensitive to semantic congruency but remarkably robust against asymmetries between different modalities.

show abstract

Section: Discussionmentioning

confidence: 99%

Semantic congruency but not temporal synchrony enhances long-term memory performance for audio-visual scenes

Meyerhoff

Huff

2015

Mem Cogn

View full text Add to dashboard Cite

show abstract

“…For audiovisual speech, sensitivity of temporal order was again worse for the gender-congruent than for the gender-incongruent trials, but there was no congruency effect for the monkey calls or for the human voice imitating the coos. also found no congruency effect for audiovisual music and object events that either matched (e.g., the sight of a note being played on a piano together with the corresponding sound, the video of a bouncing ball with a 2005; Heron, Whitaker, McGraw, & Horoshenkov, 2007;Lewald & Guski, 2004;Stone et al, 2001). See Table 1 for an overview.…”

Section: Compensation For External Factorsmentioning

confidence: 94%

“…Others, however, failed to observe compensation for distance (Arnold et al, 2005;Heron et al, 2007;Lewald & Guski, 2004;Stone et al, 2001). For example, Lewald and Guski (2004) used a rather wide range of distances (1,5,10,20, and 50 m), but their audio-visual stimuli (a sequence of five beeps/flashes) were delivered by colocated speakers/LEDs placed in the open field.…”

Section: Temporal Recalibrationmentioning

confidence: 99%

“…For example, Lewald and Guski (2004) used a rather wide range of distances (1,5,10,20, and 50 m), but their audio-visual stimuli (a sequence of five beeps/flashes) were delivered by colocated speakers/LEDs placed in the open field. Note that, in this setup, there were no violations in the "naturalness" of the audio-visual stimuli, because they were physically colocated.…”

Section: Temporal Recalibrationmentioning

confidence: 99%

See 1 more Smart Citation

Perception of intersensory synchrony: A tutorial review

Vroomen

Keetels

2010

Attention, Perception, & Psychophysics

394

390

View full text Add to dashboard Cite

“…The similarity of TOT across sensory modalities for simple stimuli is surprising given the differences of neural latencies between audition (Celesia 1976;Lakatos et al 2005) and vision (Buchner et al 1997;Schroeder 1998;Zeki 2001). Several groups have suggested the possibility of mechanisms compensating for the neural delays across the senses (Engel & Dougherty 1971;Sugita & Suzuki 2003;Kopinska & Harris 2004), but they remain controversial (Lewald & Guski 2004;Arnold et al 2005) and may not take place below the 'horizon of simultaneity', i.e. when auditory and visual sources are less than 10 m away from the observer (Pö ppel 1988;Pö ppel et al 1990).…”

Section: Two-way Non-identity Problemmentioning

confidence: 99%

Minding time in an amodal representational space

Wassenhove

2009

Phil. Trans. R. Soc. B

156

111

View full text Add to dashboard Cite

How long did it take you to read this sentence? Chances are your response is a ball park estimate and its value depends on how fast you have scanned the text, how prepared you have been for this question, perhaps your mood or how much attention you have paid to these words. Time perception is here addressed in three sections. The first section summarizes theoretical difficulties in time perception research, specifically those pertaining to the representation of time and temporal processing. The second section reviews non-exhaustively temporal effects in multisensory perception. Sensory modalities interact in temporal judgement tasks, suggesting that (i) at some level of sensory analysis, the temporal properties across senses can be integrated in building a time percept and (ii) the representational format across senses is compatible for establishing such a percept. In the last section, a two-step analysis of temporal properties is sketched out. In the first step, it is proposed that temporal properties are automatically encoded at early stages of sensory analysis, thus providing the raw material for the building of a time percept; in the second step, time representations become available to perception through attentional gating of the raw temporal representations and via re-encoding into abstract representations.

show abstract

Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception

Cited by 75 publications

References 15 publications

Semantic congruency but not temporal synchrony enhances long-term memory performance for audio-visual scenes

Semantic congruency but not temporal synchrony enhances long-term memory performance for audio-visual scenes

Perception of intersensory synchrony: A tutorial review

Minding time in an amodal representational space

Contact Info

Product

Resources

About