A backward encoding approach to recover subcortical auditory activity

Schmidt, Fabian; Demarchi, Gianpaolo; Geyer, Florian; Weisz, Nathan

doi:10.1016/j.neuroimage.2020.116961

Cited by 4 publications

(17 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other studies have shown that even subcortical nuclei on the auditory pathway are behaviorally relevant for speech recognition (medial geniculate bodies; 25 ). Using a recently developed modeling procedure ( 17 ), we further aimed to investigate whether differences in speech intelligibility can be already observed at putative subcortical processing stages.…”

Section: Resultsmentioning

confidence: 99%

“…We used a localizer measurement ( 17 ) to compute individualized weights (per subject; note that the localizer was only available for Study#2). These weights reflect activity along the auditory hierarchy, resulting in 100 virtual channels ranging putatively from the auditory nerve (channels 0-20) to early thalamo(-cortical) processing stages (channels 90-100).…”

Section: Resultsmentioning

confidence: 99%

“…These subcortical regions appear to be even behaviorally relevant for speech recognition (medial geniculate bodies; 25 ). Here, we generated individualized spatial filters reflective of subcortical auditory processing using a localizer measurement ( 17 ). In principal, these filters can be applied to a separate measurement to infer subcortical auditory activity.…”

Section: Discussionmentioning

confidence: 99%

“…In order to reconstruct auditory brainstem activity from the MEG data we applied a recently developed backward modelling approach ( 17 ) to the data obtained in Study#2. As planar gradiometers are less sensitive to sources below the cortical surface than magnetometers ( 57 ) only magnetometer data was included in this analysis.…”

Section: Discussionmentioning

confidence: 99%

“…As planar gradiometers are less sensitive to sources below the cortical surface than magnetometers ( 57 ) only magnetometer data was included in this analysis. The backward models were trained independently for each subject using data obtained from a localizer run dedicated to elicit auditory brainstem activity (see ( 17 ) for a detailed account). In brief, we used the signal captured by the MEG sensors (during the first 10ms) as regressors for a concurrent EEG recording of an auditory brainstem response (similar to the estimation of regression based ERPs ( 58 )).…”

Section: Discussionmentioning

confidence: 99%

See 4 more Smart Citations

Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases

Schmidt

Chen

Keitel

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

The most prominent acoustic features in speech are intensity modulations, represented by the amplitude envelope of speech. Synchronization of neural activity with these modulations is vital for speech comprehension. As the acoustic modulation of speech is related to the production of syllables, investigations of neural speech tracking rarely distinguish between lower-level acoustic (envelope modulation) and higher-level linguistic (syllable rate) information. Here we manipulated speech intelligibility using noise-vocoded speech and investigated the spectral dynamics of neural speech processing, across two studies at cortical and subcortical levels of the auditory hierarchy, using magnetoencephalography. Overall, cortical regions mostly track the syllable rate, whereas subcortical regions track the acoustic envelope. Furthermore, with less intelligible speech, tracking of the modulation rate becomes more dominant. Our study highlights the importance of distinguishing between envelope modulation and syllable rate and provides novel possibilities to better understand differences between auditory processing and speech/language processing disorders.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 3 more Smart Citations

Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases

Schmidt

Chen

Keitel

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

Eye movements track prioritized auditory features in selective attention to natural speech

Gehmacher,

Schubert,

Schmidt

et al. 2024

Nat Commun

Self Cite

View full text Add to dashboard Cite

Over the last decades, cognitive neuroscience has identified a distributed set of brain regions that are critical for attention. Strong anatomical overlap with brain regions critical for oculomotor processes suggests a joint network for attention and eye movements. However, the role of this shared network in complex, naturalistic environments remains understudied. Here, we investigated eye movements in relation to (un)attended sentences of natural speech. Combining simultaneously recorded eye tracking and magnetoencephalographic data with temporal response functions, we show that gaze tracks attended speech, a phenomenon we termed ocular speech tracking. Ocular speech tracking even differentiates a target from a distractor in a multi-speaker context and is further related to intelligibility. Moreover, we provide evidence for its contribution to neural differences in speech processing, emphasizing the necessity to consider oculomotor activity in future research and in the interpretation of neural differences in auditory cognition.

show abstract

Eye movements track prioritized auditory features in selective attention to natural speech

Gehmacher

Schubert

Schmidt

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

Over the last decades, cognitive neuroscience has identified a distributed set of brain regions that are critical for attention - one of the key principles of adaptive behavior. A strong anatomical overlap with brain regions critical for oculomotor processes suggests a joint network for attention and eye movements. However, the role of this shared network in complex, naturalistic environments remains understudied. Here, we investigated eye movements in relation to (un)attended sentences of natural speech in simultaneously recorded eye tracking and magnetoencephalographic (MEG) data. Using temporal response functions (TRF), we show that eye gaze tracks acoustic features (envelope and acoustic onsets) of attended speech, a phenomenon we termed ocular speech tracking. Ocular speech envelope tracking even differentiates a target from a distractor in a multi speaker context and is further related to intelligibility. Moreover, we provide evidence for its contribution to neural differences in speech processing, emphasizing the necessity to consider oculomotor activity in future research and in the interpretation of neural differences in auditory cognition. Our results extend previous findings of a joint network of attention and eye movement control as well as motor theories of speech. They provide valuable new directions for research into the neurobiological mechanisms of the phenomenon, its dependence on learning and plasticity, and its functional implications in social communication.

show abstract

A backward encoding approach to recover subcortical auditory activity

Cited by 4 publications

References 32 publications

Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases

Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases

Eye movements track prioritized auditory features in selective attention to natural speech

Eye movements track prioritized auditory features in selective attention to natural speech

Contact Info

Product

Resources

About