Audiotactile interactions in temporal perception

Abstract

In the present review, we focus on how commonalities in the ontogenetic development of the auditory and tactile sensory systems may inform the interplay between these signals in the temporal domain. In particular, we describe the results of behavioral studies that have investigated temporal resolution (in temporal order, synchrony/asynchrony, and simultaneity judgment tasks), as well as temporal numerosity perception, and similarities in the perception of frequency across touch and hearing. The evidence reviewed here highlights features of audiotactile temporal perception that are distinctive from those seen for other pairings of sensory modalities. For instance, audiotactile interactions are characterized in certain tasks (e.g., temporal numerosity judgments) by a more balanced reciprocal influence than are other modality pairings. Moreover, relative spatial position plays a different role in the temporal order and temporal recalibration processes for audiotactile stimulus pairings than for other modality pairings. The effect exerted by both the spatial arrangement of stimuli and attention on temporal order judgments is described. Moreover, a number of audiotactile interactions occurring during sensory-motor synchronization are highlighted. We also look at the audiotactile perception of rhythm and how it may be affected by musical training. The differences emerging from this body of research highlight the need for more extensive investigation into audiotactile temporal interactions. We conclude with a brief overview of some of the key issues deserving of further research in this area.Keywords Auditory . Tactile . Temporal . Frequency . Audiotactile . Crossmodal similarities . Mechanoreception . MultisensoryThe boundaries between hearing and touch: the foundation of an analogyWe continuously interact with environments that provide a large amount of multisensory information to our various senses. Researchers have now convincingly demonstrated that the inputs delivered by the different sensory channels tend to be bound together by the brain (see the section Research on hearing and touch: a multisensory perspective for a fuller discussion of this topic). Unlike the audiovisual and visuotactile sensory pairings, those interactions taking place at both the neuronal and behavioral level between audition and touch have, to date, been explored in far less detail (see Kitagawa & Spence, 2006;Soto-Faraco & Deco, 2009, for reviews of the extant literature). The paucity of research covering this modality pairing is rather surprising when one considers the wide range of everyday situations in which we experience-even though often in subtle and unconscious ways-the interplay between these two senses. Examples include perceiving the "auditory" buzzing and the itchy "tactile" sensation of an insect landing on the back of our neck; reaching for a mobile phone ringing and vibrating in our pocket. What is common to these situations is the exclusive-or, at the very least, predominant-reliance on cues provided by the

Synchronizing to auditory and tactile metronomes: a test of the auditory-motor enhancement hypothesis

“…We also show that in a real-world multimodal setting in which auditory and tactile cues are neither spatially separated nor physically distinct, that the integration of these cues may involve a common source of sensory variance. One potential source may be auditory belt areas, which are shown to be activated by both auditory and vibrotactile rhythmic pulsed stimuli (see Occelli, Spence, & Zampini, 2011, for a review).…”

When time is space: Evidence for a mental time line

“…Other kinds of cross-domain interactions (e.g. temporo-tactile) have also been described (Occelli et al, 2011, for review).…”

On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model

“…The relation between detection of asynchrony and identification of temporal order Two recurring issues in perception of temporal order are whether the detection of asynchrony is a sufficient condition for the identification of temporal order and whether detection of synchrony and identification of temporal order arise from a single processing stream (e.g., Allan, 1975;Hirsh & Sherrick, 1961;Mitrani, Shekerdjiiski, & Yakimoff, 1986; see also Occelli, Spence, & Zampini, 2011;Shore et al, 2002). The three-zone decision space in independentchannels models (see Fig.…”