Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model

Abstract

Abstract& Saccadic reaction time to visual targets tends to be faster when stimuli from another modality (in particular, audition and touch) are presented in close temporal or spatial proximity even when subjects are instructed to ignore the accessory input (focused attention task). Multisensory interaction effects measured in neural structures involved in saccade generation (in particular, the superior colliculus) have demonstrated a similar spatio-temporal dependence. Neural network models of multisensory spatial integration have been shown to generate convergence of the visual, auditory, and tactile reference frames and the sensorimotor coordinate transformations necessary for coordinated head and eye movements. However, because these models do not capture the temporal coincidences critical for multisensory integration to occur, they cannot easily predict multisensory effects observed in behavioral data such as saccadic reaction times. This article proposes a quantitative stochastic framework, the time-window-of-integration model, to account for the temporal rules of multisensory integration. Saccadic responses collected from a visual-tactile focused attention task are shown to be consistent with the time-window-of-integration model predictions. &

Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time

“…First, responses faster than those predicted by the race model may indicate only that, in addition to statistical facilitation, other mechanisms for re- sponse speedup may be effective, including interchannel crosstalk from interstimulus contingencies (see Mordkoff & Yantis, 1993) and warning signal or attention effects (see Spence, 2002); for other recent quantitative proposals for the RSE that partially retain the race concept, see Miller and Ulrich (2003), Colonius and Arndt (2001), and Colonius and Diederich (2004). Second, the behavior of multisensory neurons is complex, defying any simple extrapolation from changes in spike rate activity to RT changes.…”

Intersensory binding across space and time: A tutorial review

“…Surprisingly, from the literature, it appears that this is most likely not the case. There is a well-established finding that a variety of multisensory illusions are preserved over a time window of several hundred milliseconds surrounding simultaneity, giving rise to the notion of a "temporal window of integration" (Colonius & Diederich, 2004;Dixon & Spitz, 1980;van Wassenhove, Grant & Poeppel, 2007). In the same vein, one can adopt a "spatial window of integration" for when multisensory illusions are likely to occur.…”

Minding time in an amodal representational space

“…This window pertains to the latency of arrival of different converging neural streams, hence to internal neural processing time and not necessarily to the objective time separating two stimuli (see discussion in §1). A neural moment is thus not a point in time, but a window of time and models of multisensory perception have started to include such a notion of temporal window of integration (Colonius & Diederich 2004).…”