Distracting linguistic information impairs neural tracking of attended speech

Dai, Bohan; McQueen, James M.; Terporten, René; Hagoort, Peter; Kösem, Anne

doi:10.1016/j.crneur.2022.100043

Cited by 15 publications

(11 citation statements)

References 69 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition, brain stimulation studies showed that the manipulation of speech-aligned neural dynamics results in a change in speech perception, even though the speech stimulus itself remained unchanged (Keshavarzi et al, 2020;Riecke et al, 2018;van Bree et al, 2021;Wilsch et al, 2018;Zoefel, Archer-Boyd, et al, 2018;Zoefel et al, 2020). These findings support the notion that the intelligibility of speech per se can influence neural dynamics, and vice versa, though caution is warranted when manipulation of speech intelligibility goes along with acoustic changes, considering that a small change in acoustic parameters can have strong effects in the neural tracking response (Dai et al, 2022;Kösem et al, 2022).…”

Section: A Intelligible Speech Produces Stronger Neural Tracking Resp...mentioning

confidence: 82%

“…In addition, intelligible speech is a particularly relevant acoustic stimulus and thus prone to capture listeners' attention. Neural dynamics, including tracking of auditory rhythmic stimuli are modulated by attention (Lakatos et al, 2013), and so is their alignment to both acoustic and symbolic information in speech (Dai et al, 2022;Ding et al, 2018).…”

Section: Speech-specificity Of Neural Dynamicsmentioning

confidence: 99%

“…In all of these cases, the simultaneous reduction in neural dynamics and speech comprehension goes along with changes in the acoustic signal, making it difficult to disentangle acoustic and linguistic effects on neural dynamics (Kösem & van Wassenhove, 2017). Some studies have failed to find a correlation between neural tracking and comprehension when the intelligibility of speech was manipulated independently of its acoustics (e.g., by manipulating the intelligibility of identical, degraded speech through training) (Dai et al, 2022;Millman et al, 2015;Zoefel & VanRullen, 2016). Other studies found differences in neural tracking when contrasting participants presented with the identical physical stimulus, but who differ in their proficiency of a given language and its linguistic structure (Ding et al, 2016;Lizarazu et al, 2021), or their expectation about linguistic content (Di Liberto et al, 2018).…”

Section: A Intelligible Speech Produces Stronger Neural Tracking Resp...mentioning

confidence: 99%

See 2 more Smart Citations

Neural Dynamics in Speech Processing: Properties, Specificity and Open Questions

Zoefel¹,

Kösem²

2022

Preprint

View full text Add to dashboard Cite

Human speech is undoubtedly a particularly relevant acoustic stimulus for our species, due to its role of information transmission during communication. Previous research has aimed to map speech processing onto macro-anatomical brain structures specifically dedicated to this purpose, an endeavour that turned out to be challenging. A more recent line of research addressed the fact that speech is a dynamic signal, and instead focused on similarly dynamic neural activity. We here focus on the question of whether and how speech is special for such neural dynamics. We review findings that suggest that this is indeed the case: First, properties of human speech are strikingly similar to those found in neural dynamics, indicating that the two co-evolved. Second, neural dynamics produced by human speech have distinct, characteristic properties that are not only an amplified version of those observed during other, non-speech sounds. Although open questions remain, speech seems special for neural dynamics in humans.

show abstract

Section: A Intelligible Speech Produces Stronger Neural Tracking Resp...mentioning

confidence: 82%

Section: Speech-specificity Of Neural Dynamicsmentioning

confidence: 99%

Section: A Intelligible Speech Produces Stronger Neural Tracking Resp...mentioning

confidence: 99%

See 1 more Smart Citation

Neural Dynamics in Speech Processing: Properties, Specificity and Open Questions

Zoefel¹,

Kösem²

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…The entrainment of the speaker's neural feature needs further exploration. For the time course, we assume that the attention modulation of the acoustic feature occurs at first (Ding & Simon, 2012a, 2012bHillyard et al, 1973;O'Sullivan et al, 2015;Power et al, 2011;Teoh et al, 2022), and the attention effect of the semantic feature lasts longer (Broderick et al, 2018;Dai et al, 2022). The listener's neural activity is aligned with the speaker's neural activity in a broader time range (Dai et al, 2018;Kuhlen et al, 2012).…”

Section: Wilhelm Von Humboldtmentioning

confidence: 99%

“…Based on the previous studies, we hypothesized that attention modulates the different features in distinct ways, which means the modulation to different features would happen on different frequency bands and time ranges. For the frequency bands, we hypothesize that the delta band reflects attention modulation of the semantic feature (Dai et al, 2022;Teoh et al, 2022;Yu et al, 2022), and the theta band represents the acoustic feature (Ding et al, 2014;Etard & Reichenbach, 2019). The entrainment of the speaker's neural feature needs further exploration.…”

Section: Wilhelm Von Humboldtmentioning

confidence: 99%

EEG-based speaker-listener neural coupling reflects speech-selective attentional mechanisms beyond the speech stimulus

Hong

Nolte

et al. 2022

Preprint

View full text Add to dashboard Cite

When we are following someone when there are multiple speakers, are we just paying attention to the sound the speaker makes, the word the speaker uses, or are we aligning our minds to the attended speaker? In this process, selective attention plays a critical role. Previous studies have mainly focused on attention modulation on the single types of features from the speaker. However, attending to a speaker needs an integrative process: the sound waves, which represent acoustic features, should be heard; the meaning of the text, which represents semantic features, needs to be understood; listeners and speakers need to form a common grounding during the process, which represent the inter-brain feature. We still do not know how our brain entrains different types of features from the speaker in an integrative way. In this study, naturalistic speech was adopted to explore attention modulation. The natural language processing models and the flourishing inter-brain recording methods were adopted to qualify the different types of information from the speaker. Our study revealed that attention modulated the acoustic, semantic, and speaker's neural activity in an integrative way. When the listener pays attention to a speaker, the sound is the first to be processed: The neural activity in the theta band entrains the acoustic feature with a latency of 200~350 ms. Then, the meaning of the attended speech is parsed: the delta band modulates the attention with a latency of 200~600 ms. The listener entrains the speaker's neural activity 5 seconds before the speech onset. The entrainment of the acoustic feature and the semantic feature is correlated with each other. Only the entrainment of the attended speaker has a significant negative correlation with the comprehension score. Together, these results illustrate an integrative view of how our brain is selectively entrained to different types of information from the speaker.

show abstract

Listening to two speakers: Capacity and tradeoffs in neural speech tracking during Selective and Distributed Attention

Kaufman

Golumbic

2023

NeuroImage

View full text Add to dashboard Cite

Distracting linguistic information impairs neural tracking of attended speech

Cited by 15 publications

References 69 publications

Neural Dynamics in Speech Processing: Properties, Specificity and Open Questions

Neural Dynamics in Speech Processing: Properties, Specificity and Open Questions

EEG-based speaker-listener neural coupling reflects speech-selective attentional mechanisms beyond the speech stimulus

Listening to two speakers: Capacity and tradeoffs in neural speech tracking during Selective and Distributed Attention

Contact Info

Product

Resources

About