Composition of brain oscillations and their functions in the maintenance of auditory, visual and audio–visual speech percepts: an exploratory study

Fingelkurts, Alexander A.; Fingelkurts, Andrew A.; Krause, Christina M.

doi:10.1007/s10339-007-0175-x

Cited by 14 publications

(19 citation statements)

References 85 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…form of auditory-motor transformation such as voice perceptions involving posterior auditory cortices (Warren et al, 2005) could also activate beta modulation, in line with available evidence for speech perception based on articulatory characteristics (Eulitz and Obleser, 2007) and audiovisual multimodal integration (Fingelkurts et al, 2007).…”

Section: Dissociation Between Beta Suppression and Reboundsupporting

confidence: 82%

Internalized Timing of Isochronous Sounds Is Represented in Neuromagnetic Beta Oscillations

Fujioka

Trainor²,

Large³

et al. 2012

J. Neurosci.

490

604

View full text Add to dashboard Cite

Moving in synchrony with an auditory rhythm requires predictive action based on neurodynamic representation of temporal information. Although it is known that a regular auditory rhythm can facilitate rhythmic movement, the neural mechanisms underlying this phenomenon remain poorly understood. In this experiment using human magnetoencephalography, 12 young healthy adults listened passively to an isochronous auditory rhythm without producing rhythmic movement. We hypothesized that the dynamics of neuromagnetic beta-band oscillations (ϳ20 Hz)-which are known to reflect changes in an active status of sensorimotor functions-would show modulations in both power and phase-coherence related to the rate of the auditory rhythm across both auditory and motor systems. Despite the absence of an intention to move, modulation of beta amplitude as well as changes in cortico-cortical coherence followed the tempo of sound stimulation in auditory cortices and motor-related areas including the sensorimotor cortex, inferior-frontal gyrus, supplementary motor area, and the cerebellum. The time course of beta decrease after stimulus onset was consistent regardless of the rate or regularity of the stimulus, but the time course of the following beta rebound depended on the stimulus rate only in the regular stimulus conditions such that the beta amplitude reached its maximum just before the occurrence of the next sound. Our results suggest that the time course of beta modulation provides a mechanism for maintaining predictive timing, that beta oscillations reflect functional coordination between auditory and motor systems, and that coherence in beta oscillations dynamically configure the sensorimotor networks for auditory-motor coupling.

show abstract

Section: Dissociation Between Beta Suppression and Reboundsupporting

confidence: 82%

Internalized Timing of Isochronous Sounds Is Represented in Neuromagnetic Beta Oscillations

Fujioka

Trainor²,

Large³

et al. 2012

J. Neurosci.

490

604

View full text Add to dashboard Cite

show abstract

“…The beta band has been associated with longrange communication between different cortical regions (Fries, 2005;von Stein and Sarnthein, 2000), for example auditory-visual integration when participants are viewing talking faces (Fingelkurts et al, 2007) and at moments when the perception of an ambiguous visual stimulus changes from one interpretation to another (which we would interpret as reflecting fluctuating changes to the visual-to-semantic mappings; Okazaki et al, 2008). If AoA effects on object naming arise from longrange communication between visual representations in occipital cortex and semantic representations in anterior temporal cortex, it becomes less surprising that those modulations are revealed within the beta band.…”

Section: Discussionmentioning

confidence: 99%

Interactions between visual and semantic processing during object recognition revealed by modulatory effects of age of acquisition

et al. 2014

View full text Add to dashboard Cite

Northumbria University has developed Northumbria Research Link (NRL) to enable users to access the University's research output. Copyright © and moral rights for items on NRL are retained by the individual author(s) and/or other copyright owners. Single copies of full items can be reproduced, displayed or performed, and given to third parties in any format or medium for personal research or study, educational, or not-for-profit purposes without prior permission or charge, provided the authors, title and full bibliographic details are given, as well as a hyperlink and/or URL to the original metadata page. The content must not be changed in any way. Full items must not be sold commercially in any format or medium without formal permission of the copyright holder. The full policy is available online: http://nrl.northumbria.ac.uk/policies.html This document may differ from the final, published version of the research and has been made available online in accordance with publisher policies. To read and/or cite from the published version of the research, please visit the publisher's website (a subscription may be required.)Interactions between visual and semantic processing during object recognition revealed by modulatory effects of age of acquisition The age of acquisition (AoA) of objects and their names is a powerful determinant of processing speed in adulthood, with early-acquired objects being recognized and named faster than late-acquired objects. Previous research using fMRI . Traces of vocabulary acquisition in the brain: evidence from covert object naming. NeuroImage 33,[958][959][960][961][962][963][964][965][966][967][968] found that AoA modulated the strength of BOLD responses in both occipital and left anterior temporal cortex during object naming. We used magnetoencephalography (MEG) to explore in more detail the nature of the influence of AoA on activity in those two regions. Covert object naming recruited a network within the left hemisphere that is familiar from previous research, including visual, left occipito-temporal, anterior temporal and inferior frontal regions. Region of interest (ROI) analyses found that occipital cortex generated a rapid evoked response (~ 75-200 ms at 0-40 Hz) that peaked at 95 ms but was not modulated by AoA. That response was followed by a complex of later occipital responses that extended from ~ 300 to 850 ms and were stronger to early-than late-acquired items from ~ 325 to 675 ms at 10-20 Hz in the induced rather than the evoked component. Left anterior temporal cortex showed an evoked response that occurred significantly later than the first occipital response (~ 100-400 ms at 0-10 Hz with a peak at 191 ms) and was stronger to early-than late-acquired items from ~ 100 to 300 ms at 2-12 Hz. A later anterior temporal response from ~ 550 to 1050 ms at 5-20 Hz was not modulated by AoA. The results indicate that the initial analysis of object forms in visual cortex is not influenced by AoA. A fastforward sweep of activation from occipital and left anterior temporal cortex t...

show abstract

“…The use of vocal prosody as opposed to nonverbal vocal expressions may, in part, help to explain this difference as the most prominent envelope frequencies of human speech typically fall within the theta range [44] and oscillations in the theta band are commonly observed in auditory cortex [45]. Unsurprisingly, the theta band has been suggested to coordinate the auditory modality of AV speech [46]. Luo and Poeppel [47] suggest that changing speech patterns might be tracked by oscillatory theta activity.…”

Section: Discussionmentioning

confidence: 99%

Involvement of Right STS in Audio-Visual Integration for Affective Speech Demonstrated Using MEG

et al. 2013

View full text Add to dashboard Cite

Speech and emotion perception are dynamic processes in which it may be optimal to integrate synchronous signals emitted from different sources. Studies of audio-visual (AV) perception of neutrally expressed speech demonstrate supra-additive (i.e., where AV>[unimodal auditory+unimodal visual]) responses in left STS to crossmodal speech stimuli. However, emotions are often conveyed simultaneously with speech; through the voice in the form of speech prosody and through the face in the form of facial expression. Previous studies of AV nonverbal emotion integration showed a role for right (rather than left) STS. The current study therefore examined whether the integration of facial and prosodic signals of emotional speech is associated with supra-additive responses in left (cf. results for speech integration) or right (due to emotional content) STS. As emotional displays are sometimes difficult to interpret, we also examined whether supra-additive responses were affected by emotional incongruence (i.e., ambiguity). Using magnetoencephalography, we continuously recorded eighteen participants as they viewed and heard AV congruent emotional and AV incongruent emotional speech stimuli. Significant supra-additive responses were observed in right STS within the first 250 ms for emotionally incongruent and emotionally congruent AV speech stimuli, which further underscores the role of right STS in processing crossmodal emotive signals.

show abstract

Composition of brain oscillations and their functions in the maintenance of auditory, visual and audio–visual speech percepts: an exploratory study

Cited by 14 publications

References 85 publications

Internalized Timing of Isochronous Sounds Is Represented in Neuromagnetic Beta Oscillations

Internalized Timing of Isochronous Sounds Is Represented in Neuromagnetic Beta Oscillations

Interactions between visual and semantic processing during object recognition revealed by modulatory effects of age of acquisition

Involvement of Right STS in Audio-Visual Integration for Affective Speech Demonstrated Using MEG

Contact Info

Product

Resources

About