Multisensory interactions in the depth plane in front and rear space: A review

Stoep, Nathan Van der; Nijboer, Tanja C.W.; Stigchel, Stefan Van der; Spence, Charles

doi:10.1016/j.neuropsychologia.2014.12.007

Cited by 52 publications

(51 citation statements)

References 124 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although previously reviewed studies suggest that the integration of multisensory signals including bodily signals (i.e., tactile and proprioceptive signals) share similar laws of multisensory integration (Van der Stoep et al, 2015), we argue that multisensory integration of bodily signals relies on additional constraints that are absent or minimal for exteroceptive events. Consider the case of visuo-tactile integration.…”

Section: Multisensory Integration Of Bodily Signals Is Constrained Bycontrasting

confidence: 60%

Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness

Blanke

Slater

Serino

2015

Neuron

579

510

View full text Add to dashboard Cite

Recent work in human cognitive neuroscience has linked self-consciousness to the processing of multisensory bodily signals (bodily self-consciousness [BSC]) in fronto-parietal cortex and more posterior temporo-parietal regions. We highlight the behavioral, neurophysiological, neuroimaging, and computational laws that subtend BSC in humans and non-human primates. We propose that BSC includes body-centered perception (hand, face, and trunk), based on the integration of proprioceptive, vestibular, and visual bodily inputs, and involves spatio-temporal mechanisms integrating multisensory bodily stimuli within peripersonal space (PPS). We develop four major constraints of BSC (proprioception, body-related visual information, PPS, and embodiment) and argue that the fronto-parietal and temporo-parietal processing of trunk-centered multisensory signals in PPS is of particular relevance for theoretical models and simulations of BSC and eventually of self-consciousness.

show abstract

Section: Multisensory Integration Of Bodily Signals Is Constrained Bycontrasting

confidence: 60%

Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness

Blanke

Slater

Serino

2015

Neuron

579

510

View full text Add to dashboard Cite

show abstract

“…It is remarkable that so little attention has been paid to multisensory interactions taking place in the extrapersonal space [24]. Little is known about the cue interactions in the audiovisual perception of distance.…”

Section: Discussionmentioning

confidence: 99%

Modeling the Perception of Audiovisual Distance: Bayesian Causal Inference and Other Models

2016

View full text Add to dashboard Cite

Studies of audiovisual perception of distance are rare. Here, visual and auditory cue interactions in distance are tested against several multisensory models, including a modified causal inference model. In this causal inference model predictions of estimate distributions are included. In our study, the audiovisual perception of distance was overall better explained by Bayesian causal inference than by other traditional models, such as sensory dominance and mandatory integration, and no interaction. Causal inference resolved with probability matching yielded the best fit to the data. Finally, we propose that sensory weights can also be estimated from causal inference. The analysis of the sensory weights allows us to obtain windows within which there is an interaction between the audiovisual stimuli. We find that the visual stimulus always contributes by more than 80% to the perception of visual distance. The visual stimulus also contributes by more than 50% to the perception of auditory distance, but only within a mobile window of interaction, which ranges from 1 to 4 m.

show abstract

“…An important yet often ignored aspect of multisensory processing that strongly relates to the spatial and temporal properties of multisensory processing is the depth or distance of the stimuli (see Van der Stoep et al 2015a, 2016a for reviews). Indeed, the fact that we perceive and act on stimuli at varying distances poses an interesting challenge for the nervous system.…”

Section: Introductionmentioning

confidence: 99%

Audiovisual integration in depth: multisensory binding and gain as a function of distance

et al. 2018

View full text Add to dashboard Cite

The integration of information across sensory modalities is dependent on the spatiotemporal characteristics of the stimuli that are paired. Despite large variation in the distance over which events occur in our environment, relatively little is known regarding how stimulus-observer distance affects multisensory integration. Prior work has suggested that exteroceptive stimuli are integrated over larger temporal intervals in near relative to far space, and that larger multisensory facilitations are evident in far relative to near space. Here, we sought to examine the interrelationship between these previously established distance-related features of multisensory processing. Participants performed an audiovisual simultaneity judgment and redundant target task in near and far space, while audiovisual stimuli were presented at a range of temporal delays (i.e., stimulus onset asynchronies). In line with the previous findings, temporal acuity was poorer in near relative to far space. Furthermore, reaction time to asynchronously presented audiovisual targets suggested a temporal window for fast detection—a range of stimuli asynchronies that was also larger in near as compared to far space. However, the range of reaction times over which multisensory response enhancement was observed was limited to a restricted range of relatively small (i.e., 150 ms) asynchronies, and did not differ significantly between near and far space. Furthermore, for synchronous presentations, these distance-related (i.e., near vs. far) modulations in temporal acuity and multisensory gain correlated negatively at an individual subject level. Thus, the findings support the conclusion that multisensory temporal binding and gain are asymmetrically modulated as a function of distance from the observer, and specifies that this relationship is specific for temporally synchronous audiovisual stimulus presentations.Electronic supplementary materialThe online version of this article (10.1007/s00221-018-5274-7) contains supplementary material, which is available to authorized users.

show abstract

Multisensory interactions in the depth plane in front and rear space: A review

Cited by 52 publications

References 124 publications

Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness

Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness

Modeling the Perception of Audiovisual Distance: Bayesian Causal Inference and Other Models

Audiovisual integration in depth: multisensory binding and gain as a function of distance

Contact Info

Product

Resources

About