Representational interactions during audiovisual speech entrainment: Redundancy in left posterior superior temporal gyrus and synergy in left motor cortex

Park, Hyojin; Ince, Robin A. A.; Schyns, Philippe G.; Thut, Gregor; Groß, Joachim

doi:10.1371/journal.pbio.2006558

Cited by 68 publications

(97 citation statements)

References 57 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This phase alignment in turn determines systematic, stimulus-locked variations in neuronal activity, as indexed by fluctuations in broadband high-frequency activity. It was further shown that visual speech gestures enhance intelligibility by facilitating auditory cortical entrainment to the speech stream (Crosse, Butler and Lalor, 2015;Perrodin et al, 2015;Park et al, 2016Park et al, , 2018Di Liberto et al, 2018;Micheli et al, 2018). Here, we used iEEG recordings for a more direct examination of the neurophysiological mechanisms underlying visual enhancement of auditory cortical speech processing.…”

Section: Discussionmentioning

confidence: 99%

“…There is strong support for the phase-reset hypothesis in non-human primates (Perrodin et al, 2015). In humans, noninvasive neurophysiology has brought solid evidence that visual speech entrains oscillatory activity in widespread regions of the cerebral cortex, including areas involved in speech perception and production (Crosse, Butler and Lalor, 2015;Park et al, 2016Park et al, , 2018. However, limitations inherent to noninvasive methods leave two crucial sets of questions unanswered.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Phase resetting in human auditory cortex to visual speech

Mégevand

Mercier

Groppe

et al. 2018

Preprint

View full text Add to dashboard Cite

Natural conversation is multisensory: when we can see the speaker's face, visual speech cues influence our perception of what is being said. The neuronal basis of this phenomenon remains unclear, though there is indication that neuronal oscillations-ongoing excitability fluctuations of neuronal populations in the brain-represent a potential mechanism. Investigating this question with intracranial recordings in humans, we show that some sites in auditory cortex track the temporal dynamics of unisensory visual speech using the phase of their slow oscillations and phase-related modulations in neuronal activity. This effect is asymmetric, as we find much less detectable tracking of auditory speech by visual cortex. Auditory cortex thus builds a representation of the speech stream's envelope based on visual speech alone, at least in part by resetting the phase of its ongoing oscillations. Phase reset amplifies the representation of the speech stream and organizes the information contained in neuronal activity patterns.Keywords: neuronal oscillations, crossmodal stimuli, intracranial EEG, intertrial phase coherence, broadband high-frequency activity, phase-amplitude coupling reconstruction; Bahar Khalighinejad for help with stimulus reconstruction. Part of the computations for this work were performed at the University of Geneva on the Baobab cluster.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Phase resetting in human auditory cortex to visual speech

Mégevand

Mercier

Groppe

et al. 2018

Preprint

View full text Add to dashboard Cite

show abstract

“…PID was previously used to decompose the information brought by acoustic and visual speech signals about brain oscillatory activity, 73 and to compare auditory encoding models of MEG during speech processing. 62 As in these references, we measure redundancy with pointwise common change in surprisal for Gaussian variables.…”

Section: Partial Information Decompositionmentioning

confidence: 99%

Cortical tracking of speech in noise accounts for reading strategies in children

Destoky

Bertels

Niesen

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Humans’ propensity to acquire literacy relates to several factors, among which, the ability to understand speech in noise (SiN). Still, the nature of the relation between reading and SiN perception abilities remains poorly understood. Here, we dissect the interplay between (i) reading abilities, (ii) classical behavioral predictors of reading (phonological awareness, phonological memory and lexical access), and (iii) electrophysiological markers of SiN perception in 99 elementary school children (26 with dyslexia). We demonstrate that cortical representation of phrasal content of SiN relates to the development of the lexical (but not sublexical) reading strategy. In contrast, classical behavioral predictors of reading abilities and the ability to benefit from visual speech to represent the syllabic content of SiN account for global reading performance (i.e., speed and accuracy of lexical and sublexical reading). Finally, we found that individuals with dyslexia properly integrate visual speech information to optimize processing of syntactic information, but not to sustain acoustic/phonemic processing. These results clarify the nature of the relation between SiN perception and reading abilities in typical and dyslexic child readers, and identified novel electrophysiological markers of emergent literacy.

show abstract

“…The partial information decomposition has been applied to data in neuroscience; see, e.g. [46,47,48,49]. For a recent overview, see [50].…”

Section: Application Of Partial Information Decompositionmentioning

confidence: 99%

Bayesian modeling of BAC firing as a mechanism for apical amplification in neocortical pyramidal neurons

Kay¹,

Phillips

Aru

et al. 2019

Preprint

View full text Add to dashboard Cite

Pyramidal cells in layer 5 of the neocortex have two distinct integration sites. These cells integrate inputs to basal dendrites in the soma while integrating inputs to the tuft in a site at the top of the apical trunk. The two sites communicate by action potentials that backpropagate to the apical site and by backpropagation-activated calcium spikes (BAC firing) that travel from the apical to the somatic site. Six key messages arise from the probabilistic information-theoretic analyses of BAC firing presented here. First, we suggest that pyramidal neurons with BAC firing could convert the odds in favour of the presence of a feature given the basal data into the odds in favour of the presence of a feature given the basal data and the apical input, by a simple Bayesian calculation. Second, the strength of the cell's response to basal input can be amplified when relevant to the current context, as specified by the apical input, without corrupting the message that it sends. Third, these analyses show rigorously how this apical amplification depends upon communication between the sites. Fourth, we use data on action potentials from a very detailed multi-compartmental biophysical model to study our general model in a more realistic setting, and demonstrate that it describes the data well. Fifth, this form of BAC firing meets criteria for distinguishing modulatory from driving interactions that have been specified using recent definitions of multivariate mutual information. Sixth, our general decomposition can be extended to cases where, instead of being purely driving or purely amplifying, apical and basal inputs can be partly driving and partly amplifying to various extents. These conclusions imply that an advance beyond the assumption of a single site of integration within pyramidal cells is needed, and suggest that the evolutionary success of neocortex may depend upon the cellular mechanisms of context-sensitive selective amplification hypothesized here. Author summaryThe cerebral cortex has a key role in conscious perception, thought, and action, and is predominantly composed of a particular kind of neuron: the pyramidal cells. The distinct shape of the pyramidal neuron with a long dendritic shaft separating two regions of profuse dendrites allows them to integrate inputs to the two regions separately and combine the results non-linearly to produce output. Here we show how inputs to this more distant site strengthen the cell's output 1 when it is relevant to the current task and environment. By showing that such neurons have capabilities that transcend those of neurons with the single site of integration assumed by many neuroscientists, this 'splitting of the neuronal atom' offers a radically new viewpoint from which to understand the evolution of the cortex and some of its many pathologies. This also suggests that approaches to artificial intelligence using neural networks might come closer to something analogous to real intelligence, if, instead of basing them on processing elements with a single site of integra...

show abstract

Representational interactions during audiovisual speech entrainment: Redundancy in left posterior superior temporal gyrus and synergy in left motor cortex

Cited by 68 publications

References 57 publications

Phase resetting in human auditory cortex to visual speech

Phase resetting in human auditory cortex to visual speech

Cortical tracking of speech in noise accounts for reading strategies in children

Bayesian modeling of BAC firing as a mechanism for apical amplification in neocortical pyramidal neurons

Contact Info

Product

Resources

About