Neural Oscillations Orchestrate Multisensory Processing

Abstract

At any given moment, we receive input through our different sensory systems, and this information needs to be processed and integrated. Multisensory processing requires the coordinated activity of distinct cortical areas. Key mechanisms implicated in these processes include local neural oscillations and functional connectivity between distant cortical areas. Evidence is now emerging that neural oscillations in distinct frequency bands reflect different mechanisms of multisensory processing. Moreover, studies suggest that aberrant neural oscillations contribute to multisensory processing deficits in clinical populations, such as schizophrenia. In this article, we review recent literature on the neural mechanisms underlying multisensory processing, focusing on neural oscillations. We derive a framework that summarizes findings on (1) stimulus-driven multisensory processing, (2) the influence of top-down information on multisensory processing, and (3) the role of predictions for the formation of multisensory perception. We propose that different frequency band oscillations subserve complementary mechanisms of multisensory processing. These processes can act in parallel and are essential for multisensory processing.

Shift in lateralization during illusory self‐motion: EEG responses to visual flicker at 10 Hz and frequency‐specific modulation by tACS

“…There are a number of ways in which these proposed roles of alpha oscillations could mediate visual–vestibular interactions: firstly as a gating mechanism to integrate modality‐specific inputs arriving from distant neural areas. This fits with the idea that coherence of oscillatory neural signals is critical for multisensory perception (Keil & Senkowski, ; Senkowski, Schneider, Foxe, & Engel, ). Secondly, alpha oscillations could reflect the inhibition of movement in the visual field due to self‐motion, in line with a general role for alpha‐band oscillations in suppression and selection of attention and the ability to be consciously oriented in time and space (Klimesch, ).…”

The interplay between multisensory integration and perceptual decision making

“…The different sensory channels provide complementary information, the integration of 3 which leads to more accurate and faster behavioral decision (Welch and Warren, 1980;Stein and 4 Meredith, 1993). The neural basis of multisensory integration and its loci in the hierarchy of brain 5 computations have been the focus of myriad of studies (see for reviews (Talsma et al, 2010;ten 6 Oever et al, 2016;Keil and Senkowski, 2018)). It is now well established that multisensory 7 integration starts early in the process chain Schroeder and Foxe, 8 2005): both animal and human studies have demonstrated that the genesis of multisensory 9 integration relies on cross-modal inputs to sensory cortices which informs about the 10 spatiotemporal co-occurrence of sensory cues (Bizley et al, 2007;Lakatos et al, 2007;Kayser 11 et al, 2008;Cappe et al, 2010;Mercier et al, 2013Mercier et al, , 2015Atilgan et al, 2018).…”

Causally Linking Neural Dominance to Perceptual Dominance in a Multisensory Conflict

“…In other words, the fact that there was only enhancement but no suppression effect might be due to a flooring effect and/or inherent hard connectivity between sensory cortices. Our findings also critically implicate the role of the neural oscillations and effective connectivity, especially in the alpha frequency range [25], subserving multisensory processing [2].…”

“…We continuously encounter with visual and auditory information, processed by distinct sensory cortices, which are eventually integrated to produce a conscious behavioral unique response [1, 2]. However, when visual and auditory information is incongruent or in conflict, one sensory modality may dominate the other, leading towards a multisensory illusion [3].…”