Multisensory Role of Human Auditory Cortex

Wassenhove, Virginie van; Schroeder, Charles E.

doi:10.1007/978-1-4614-2314-0_11

Cited by 8 publications

(8 citation statements)

References 192 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Given the dependence of the behavioural effect on linguistic attributes, we predict that this rapid, automatic shift in the eSTRF originates at least in part from top-down signals in higher-level regions that are part of the language network such as auditory association areas45464748, or in ‘non-auditory' regions such as the inferior frontal gyrus or premotor cortices49.…”

Section: Discussionmentioning

confidence: 99%

Rapid tuning shifts in human auditory cortex enhance speech intelligibility

et al. 2016

View full text Add to dashboard Cite

Experience shapes our perception of the world on a moment-to-moment basis. This robust perceptual effect of experience parallels a change in the neural representation of stimulus features, though the nature of this representation and its plasticity are not well-understood. Spectrotemporal receptive field (STRF) mapping describes the neural response to acoustic features, and has been used to study contextual effects on auditory receptive fields in animal models. We performed a STRF plasticity analysis on electrophysiological data from recordings obtained directly from the human auditory cortex. Here, we report rapid, automatic plasticity of the spectrotemporal response of recorded neural ensembles, driven by previous experience with acoustic and linguistic information, and with a neurophysiological effect in the sub-second range. This plasticity reflects increased sensitivity to spectrotemporal features, enhancing the extraction of more speech-like features from a degraded stimulus and providing the physiological basis for the observed ‘perceptual enhancement' in understanding speech.

show abstract

Section: Discussionmentioning

confidence: 99%

Rapid tuning shifts in human auditory cortex enhance speech intelligibility

et al. 2016

View full text Add to dashboard Cite

show abstract

“…In many species, non-auditory inputs have been found to modulate the response properties of auditory neurons throughout the auditory pathway (Cahill et al, 1996 ; Schroeder et al, 2001 ; Wallace et al, 2004 ; Cappe and Barone, 2005 ; Ghazanfar et al, 2005 ; Budinger et al, 2006 ; Bizley et al, 2007 ; Lakatos et al, 2007 ; Bizley and King, 2008 ). In auditory association cortices, visual modulations are mediated by feedback and lateral projections as defined by laminar profiling and anatomical connectivity (Rockland and Pandya, 1979 ; Felleman and van Essen, 1991 ; Rockland and Ojima, 2003 ; van Wassenhove and Schroeder, 2012 ). Non-specific feed-forward projections via koniocellular neurons have also been mentioned to potentially contribute to these modulations (Fu et al, 2003 ; Schroeder et al, 2003 ).…”

Section: Discussionmentioning

confidence: 99%

Visual-induced expectations modulate auditory cortical responses

Wassenhove

Grzeczkowski

2015

Front. Neurosci.

Self Cite

View full text Add to dashboard Cite

Active sensing has important consequences on multisensory processing (Schroeder et al., 2010). Here, we asked whether in the absence of saccades, the position of the eyes and the timing of transient color changes of visual stimuli could selectively affect the excitability of auditory cortex by predicting the “where” and the “when” of a sound, respectively. Human participants were recorded with magnetoencephalography (MEG) while maintaining the position of their eyes on the left, right, or center of the screen. Participants counted color changes of the fixation cross while neglecting sounds which could be presented to the left, right, or both ears. First, clear alpha power increases were observed in auditory cortices, consistent with participants' attention directed to visual inputs. Second, color changes elicited robust modulations of auditory cortex responses (“when” prediction) seen as ramping activity, early alpha phase-locked responses, and enhanced high-gamma band responses in the contralateral side of sound presentation. Third, no modulations of auditory evoked or oscillatory activity were found to be specific to eye position. Altogether, our results suggest that visual transience can automatically elicit a prediction of “when” a sound will occur by changing the excitability of auditory cortices irrespective of the attended modality, eye position or spatial congruency of auditory and visual events. To the contrary, auditory cortical responses were not significantly affected by eye position suggesting that “where” predictions may require active sensing or saccadic reset to modulate auditory cortex responses, notably in the absence of spatial orientation to sounds.

show abstract

“…While this does not preclude additional dynamic stimulus features also contributing, including higher-order linguistic elements (e.g. Di Liberto et al, 2015;Kayser et al, 2015;Näätänen and Winkler, 1999;Wassenhove and Schroeder, 2012), the suggestion that a key neural property of natural sound encoding is via temporally-based acoustic representations is underscored by their active maintenance during noise gaps, based on prior experience.…”

Section: 4mentioning

confidence: 99%

“…The ability to correctly interpret speech despite disruptions masking a conversation is a hallmark of communication (Cherry, 1953). In many cases, contextual knowledge poses clear informational advantages for a listener, so as to successfully disengage the masker and restore the intended template signal (Shahin et al, 2009;Riecke et al, 2012;van Wassenhove and Schroeder, 2012;Leonard et al, 2016;. Relevant information is available from multimodal sources and/or lowlevel auditory and higher-level linguistic analyses, although it remains unclear how and which factors are most effective in assisting speech restoration under natural conditions.…”

Section: Introductionmentioning

confidence: 99%

“…In this forward model case, we analyze cortical latencies involved in natural speech processing under different prior knowledge conditions. The possibility of reduced cortical latencies is of particular interest since faster processing has been observed in situations where additional context facilitates integration of incoming speech (van Wassenhove et al, 2005;van Wassenhove and Schroeder, 2012). Additionally, similar task-related cortical plasticity changes in stimulus-response mappings are often observed at the neuronal level Fritz et al, 2003) and represent a potential biophysical basis for restorative mechanisms given the present task demands.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

The neural representation of missing speech and the influence of prior knowledge on cortical fidelity and latency

Constantino¹,

Simon²

2018

Preprint

View full text Add to dashboard Cite

In naturally noisy listening conditions, for example at a cocktail party, noise disruptions may completely mask significant parts of a sentence, and yet listeners may still perceive the missing speech as being present. Here we demonstrate that dynamic speech-related auditory cortical activity, as measured by magnetoencephalography (MEG), which can ordinarily be used to directly reconstruct to the physical speech stimulus, can also be used to "reconstruct" acoustically missing speech. The extent to which this occurs depends on the extent that listeners are familiar with the missing speech, which is consistent with this neural activity being a dynamic representation of perceived speech even if acoustically absence. Our findings are two-fold: first, we find that when the speech is entirely acoustically absent, the acoustically absent speech can still be reconstructed with performance up to 25% of that of acoustically present speech without noise; and second, that this same expertise facilitates faster processing of natural speech by approximately 5 ms. Both effects disappear when listeners have no or very little prior experience with a given sentence. Our results suggest adaptive mechanisms of consolidation of detailed representations about speech, and the enabling of strong expectations this entails, as identifiable factors assisting automatic speech restoration over ecologically relevant timescales.. CC-BY 4.0 International license It is made available under a (which was not peer-reviewed) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity.The copyright holder for this preprint . http://dx.doi.org/10.1101/251793 doi: bioRxiv preprint first posted online 3 IntroductionThe ability to correctly interpret speech despite disruptions masking a conversation is a hallmark of communication (Cherry, 1953). In many cases, contextual knowledge poses clear informational advantages for a listener, so as to successfully disengage the masker and restore the intended template signal (Shahin et al., 2009;Riecke et al., 2012;van Wassenhove and Schroeder, 2012;Leonard et al., 2016;. Relevant information is available from multimodal sources and/or lowlevel auditory and higher-level linguistic analyses, although it remains unclear how and which factors are most effective in assisting speech restoration under natural conditions.For instance, while cortical network activity profiles have been identified that are consistent with phonemic restoration (the effect where absent phonemes in a signal may nonetheless be heard (Samuel, 1996(Samuel, , 1981) in binary semantic decision tasks (Leonard et al., 2016), the factors that bias into one or the other of two perceptual alternatives remain unclear. There is evidence that such restorative processes may be influenced by contributions from audiovisual integration cues (Crosse et al., 2016), lexical priming (Sohoglu et al., 2012), and within the auditory domain, by predictive template matching (SanMiguel et al., 2013) or even intentional exp...

show abstract

Multisensory Role of Human Auditory Cortex

Cited by 8 publications

References 192 publications

Rapid tuning shifts in human auditory cortex enhance speech intelligibility

Rapid tuning shifts in human auditory cortex enhance speech intelligibility

Visual-induced expectations modulate auditory cortical responses

The neural representation of missing speech and the influence of prior knowledge on cortical fidelity and latency

Contact Info

Product

Resources

About