Spatial References and Audio-Tactile Interaction in Cross-Modal Dynamic Capture

Abstract

In audiotactile dynamic capture, judgment of the direction of an apparent motion stream (such as auditory motion) was impeded (hence 'captured') by the presentation of a concurrent, but directionally opposite apparent motion stream (such as tactile motion) from a distractor modality, leading to a cross-modal dynamic capture (CDC) effect. That is to say, the percentage of correct reporting of the direction of the target motion was reduced. Previous studies have revealed the effect of stimulus onset asynchronies (SOAs) and the potential spatial remapping (by adopting a cross-hands posture) in CDC. However, further exploration of the dynamic capture process under different postures was not available due to the fact that only two levels of time asynchronies were employed (either synchronous or with an SOA of 500 ms). This study introduced a broad range of SOAs (-400 ms to 400 ms, tactile stream preceded auditory stream or vice versa) to explore the time course of audio-tactile interaction in CDC with two spatial references -arms-uncrossed or arms-crossed postures. Participants judged the direction of auditory apparent motion with tactile distractors. The results showed that in the armsuncrossed condition, the CDC effect was prominent when the auditory-tactile events were in the temporal integration window (0-60 ms). However, with a preceding tactile cueing effect of SOA equal to and above 150 ms, the CDC effect was reduced, and no CDC effect was observed with the arms-crossed posture. These results suggest CDC effect is modulated by both cross-modal interaction and the spatial reference (especially for the distractors). The magnitude of the CDC effects in audiotactile interaction may be accounted for by reliability of tactile spatial-temporal information.

Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

“…Similar effects of posture on apparent-motion perception have been demonstrated in the so-called cross-modal dynamic capture effect, in which the perceived direction of tactile apparent motion is biased toward the direction of a concurrent visual (Craig, 2006;Lyons, Sanabria, Vatakis, & Spence, 2006) or auditory (Soto-Faraco, Spence, & Kingstone, 2004) apparent-motion stream. Cross-modal capture effects were found to be influenced by the hands' crossing status (Chen, Wang, & Bao, 2014;Jiang & Chen, 2013;Sanabria, Soto-Faraco, & Spence, 2005), suggesting that the discrimination of tactile motion direction was impaired when a nondefault posture was adapted (Zampini, Harris, & Spence, 2005). Importantly, posture only affected the perceived direction of apparent motion, whereas the strength of the motion percept was rated similarly in crossed and uncrossed postures (Jiang & Chen, 2013;Takahashi et al, 2013).…”