Neural basis of multisensory looming signals

Tyll, Sascha; Bonath, Björn; Schoenfeld, Mircea Ariel; Heinze, Hans‐Jochen; Ohl, Frank W.; Noesselt, Toemme

doi:10.1016/j.neuroimage.2012.09.056

Cited by 68 publications

(70 citation statements)

References 91 publications

(135 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Still others have likewise reported increased coupling between auditory and primary visual cortices, particularly under conditions of synchronous stimulation across the senses (Lewis and Noppeney, 2010;Tyll et al, 2013), that may perhaps be mediated by thalamic circuits (Noesselt et al, 2010;Bonath et al, 2013). In the same vein, sounds have been shown to activate visual cortices as a function of prior multisensory experiences (Zangenehpour and Zatorre, 2010;Meylan and Murray, 2007; see also Murray et al, 2004Murray et al, , 2005Thelen et al, 2012Thelen et al, , 2014 for effects of prior multisensory contexts on sensory processing).…”

Section: Haemodynamic Imagingmentioning

confidence: 94%

The multisensory function of the human primary visual cortex

et al. 2016

View full text Add to dashboard Cite

2It has been nearly ten years since Ghazanfar and Schroeder (2006) proposed that the neocortex is essentially multisensory in nature. However, it is only recently that sufficient and hard evidence that supports this proposal has accrued. We review evidence that activity within the human primary visual cortex plays an active role in multisensory processes and directly impacts behavioural outcome. This evidence emerges from a full pallet of human brain imaging and brain mapping methods with which multisensory processes are quantitatively assessed by taking advantage of particular strengths of each technique as well as advances in signal analyses. Several general conclusions about multisensory processes in primary visual cortex of humans are supported relatively solidly. First, haemodynamic methods (fMRI/PET) show that there is both convergence and integration occurring within primary visual cortex. Second, primary visual cortex is involved in multisensory processes during early post-stimulus stages (as revealed by EEG/ERP/ERFs as well as TMS). Third, multisensory effects in primary visual cortex directly impact behaviour and perception, as revealed by correlational (EEG/ERPs/ERFs) as well as more causal measures (TMS/tACS). While the provocative claim of Ghazanfar and Schroeder (2006) that the whole of neocortex is multisensory in function has yet to be demonstrated, this can now be considered established in the case of the human primary visual cortex.

show abstract

Section: Haemodynamic Imagingmentioning

confidence: 94%

The multisensory function of the human primary visual cortex

et al. 2016

View full text Add to dashboard Cite

show abstract

“…The co-activation and expectation mechanisms are not mutually exclusive ( Figure 1A).Notably, the detection of congruence across certain perceptual features of multisensory stimuli might sometimes have a more hardwired nature, which is possibly based on the properties of receptive fields of multisensory neurons ( Figure 1A). The detection of the looming quality within multisensory stimuli results in stronger MSI across autonomic, behavioural, and neural responses when compared with stationary multisensory stimuli Spierer et al 2013;Tyll et al 2013;Cecere et al 2014;Finisguerra et al 2015). For example, visual "go/nogo" movement detection judgements are faster if the visual stimuli are accompanied by irrelevant looming sounds, compared tostationary or receding sounds, and these selective benefits are linked to early brain-response modulations within temporal, parietal, and occipital cortices as well as, notably, the amygdala (Cappe et al , 2012.…”

Section: Stimulus-based Effectsmentioning

confidence: 99%

The COGs (context, object, and goals) in multisensory processing

et al. 2016

View full text Add to dashboard Cite

Our understanding of how perception operates in real-world environments has been substantially advanced by studying both multisensoryprocesses and "top-down" control processes influencing sensory processing via activity from higher-order brain areas, such as attention, memory, and expectations. As the two topicshave been traditionally studied separately, the mechanisms orchestrating real-world multisensory processingremain unclear.Past work has revealed that the observer's goals gate the influence of many multisensory processes on brain and behavioural responses, whereas some other multisensory processes mightoccur independently of these goals. Consequently, other forms of top-down control beyond goaldependence are necessaryto explain the full range of multisensory effects currently reported at the brain and the cognitive level. These forms of control includesensitivity to stimulus context as well as the detection of matches(or lack thereof) between a multisensory stimulus and categorical attributes of naturalistic objects (e.g. tools, animals). In this review we discuss and integrate the existing findings that demonstrate the importance of such goal-, object-and context-based top-down control over multisensory processing. We then put forward a few principles emerging from this literature review with respect to the mechanisms underlying multisensory processing, and discuss their possible broader implications. Attention, multisensory, control, object, audiovisual, brain mapping 3 Research from the past 30 years has demonstrated a whole range of behavioural benefits engendered by integrating information across the senses (multisensory integration, MSI), including faster motor responses and facilitated object recognition in noisy environments (e.g. Stein 2012). In a separate and independent manner, studies employing unisensory stimuli have been critically advancing our understanding of the nature and the importance of top-down mechanisms that control information processing. Thetopdown nature of these mechanisms lies in that they shape perceptual processing of new inputs by activating information stored in higher-order brain areas (e.g. Summerfield and Egner 2009). Key words:Studies of top-down control have traditionally focused on attentional (i.e. goaldependent)mechanisms, which promote the processing of stimulior objects in the environment that areimportant tothe current behavioural goals of the observer (e.g.Desimone and Duncan 1995). These mechanisms enhance the processing of stimuli appearing in task-relevant spatial locations and/or moments in time. These mechanisms likewise facilitate the processingof those stimuli whose attributes (e.g. colour red), feature dimensions (e.g. shape) or identity (e.g. a particular face) match the observer's goals.Simultaneously, it has been increasingly recognised in the literature that information processing issensitive to other types oftop-down processes, principally those gauged by thememory of past stimulation and one's expectations (see Figure 1A for a summar...

show abstract

“…Second, we expected to find signatures of multi-sensory regularity matching in regions implicated in integrating temporally unfolding low-level sensory features of auditory and visual stimuli (rather than ones based on distributional features). These include V5/MT+ (Sadaghiani, Maier, & Noppeney, 2009), the posterior superior temporal sulcus (pSTS; Tyll et al, 2013), superior temporal gyri bilaterally (Baumann & Greenlee, 2007), and visual area V3 (Ogawa & Macaluso, 2013). It has also been shown that when people observe movement sequences, matching audiovisual stimuli evoke greater activity in V5/MT+ than mismatching ones (Scheef et al, 2009).…”

Section: Introductionmentioning

confidence: 99%

Visual cortex signals a mismatch between regularity of auditory and visual streams

2017

View full text Add to dashboard Cite

Understanding how humans code for and respond to environmental uncertainty/regularity is a question shared by current computational and neurobiological approaches to human cognition. To date, studies investigating neurobiological systems that track input uncertainty have examined responses to uni-sensory streams. It is not known, however, whether there exist brain systems that combine information about the regularity of input streams presented to different senses. We report an fMRI study that aimed to identify brain systems that relate statistical information across sensory modalities. We constructed temporally extended auditory and visual streams, each of which could be random or highly regular, and presented them concurrently. We found strong signatures of "regularity matching" in visual cortex bilaterally; responses were higher when the level of regularity in the auditory and visual streams mismatched than when it matched, [(AudHigh/VisLow and AudLow/VisHigh) > (AudLow/VisLow and AudHigh/VisHigh)]. In addition, several frontal and parietal regions tracked regularity of the auditory or visual stream independently of the other stream's regularity. An individual-differences analysis showed that signatures of single-modality-focused regularity tracking in these fronto-parietal regions are inversely related to signatures of regularity-matching in visual cortex. Our findings suggest that i) visual cortex is a junction for integration of temporally-extended auditory and visual inputs and that ii) multisensory regularity-matching depends on balanced processing of both input modalities. We discuss the implications of these findings for neurobiological models of uncertainty and for understanding computations that underlie multisensory interactions in occipital cortex.3

show abstract

Neural basis of multisensory looming signals

Cited by 68 publications

References 91 publications

The multisensory function of the human primary visual cortex

The multisensory function of the human primary visual cortex

The COGs (context, object, and goals) in multisensory processing

Visual cortex signals a mismatch between regularity of auditory and visual streams

Contact Info

Product

Resources

About