Perception of matching and conflicting audiovisual speech in dyslexic and fluent readers: An fMRI study at 3 T

Pekkola, Johanna; Laasonen, Marja; Ojanen, Ville; Autti, Taina; Jä̈askëlainen, Iiro P.; Kujala, Teija; Sams, Mikko

doi:10.1016/j.neuroimage.2005.09.069

Cited by 90 publications

(77 citation statements)

References 98 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…These motor and premotor activations are in accordance with previous studies on auditory, visual, and audiovisual speech perception showing a key role of motor regions in speech processing (e.g., d'Ausilio et al, 2009d'Ausilio et al, , 2011Sato et al, 2009Sato et al, , 2010Möttönen & Watkins, 2009;Meister et al, 2007;Skipper et al, 2005Skipper et al, , 2007Pekkola et al, 2006;Pulvermuller et al, 2006;Wilson & Iacoboni, 2006;Ojanen et al, 2005;Callan et al, 2003Callan et al, , 2004Watkins & Paus, 2004;Wilson et al, 2004;Calvert & Campbell, 2003;Watkins et al, 2003;Campbell et al, 2001;Calvert et al, 2000). It is worthwhile noting that, in this study, participants were only asked to attentively listen to and/or watch speech stimuli.…”

Section: Visuo-lingual and Visuo-facial Speech Stimuli Share A Commonsupporting

confidence: 91%

“…colleagues (2003, 2004) also demonstrated increased motor activity under adverse listening or viewing conditions during bimodal speech presentation. In addition, increased activity or, on the contrary, subadditive responses in the Broca's area have also been reported during the perception of incongruent compared with congruent audiovisual speech stimuli (Pekkola et al, 2006;Ojanen et al, 2005) or compared with unimodal speech stimuli (Calvert et al, 2000). From these results, multisensory areas and speech motor regions appear as good candidates for brain areas where acoustic and visual speech signals can interact, which suggests a possible integration between incoming sensory signals and speech motor knowledge specific to the listener.…”

Section: Motor Resonance Extends To Speech Actionmentioning

confidence: 92%

See 1 more Smart Citation

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Treille

Vilain

Hueber

et al. 2017

Journal of Cognitive Neuroscience

View full text Add to dashboard Cite

Abstract■ Action recognition has been found to rely not only on sensory brain areas but also partly on the observer's motor system. However, whether distinct auditory and visual experiences of an action modulate sensorimotor activity remains largely unknown. In the present sparse sampling fMRI study, we determined to which extent sensory and motor representations interact during the perception of tongue and lip speech actions. Tongue and lip speech actions were selected because tongue movements of our interlocutor are accessible via their impact on speech acoustics but not visible because of its position inside the vocal tract, whereas lip movements are both "audible" and visible. Participants were presented with auditory, visual, and audiovisual speech actions, with the visual inputs related to either a sagittal view of the tongue movements or a facial view of the lip movements of a speaker, previously recorded by an ultrasound imaging system and a video camera. Although the neural networks involved in visual visuo-lingual and visuo-facial perception largely overlapped, stronger motor and somatosensory activations were observed during visuo-lingual perception. In contrast, stronger activity was found in auditory and visual cortices during visuo-facial perception. Complementing these findings, activity in the left premotor cortex and in visual brain areas was found to correlate with visual recognition scores observed for visuo-lingual and visuo-facial speech stimuli, respectively, whereas visual activity correlated with RTs for both stimuli. These results suggest that unimodal and multimodal processing of lip and tongue speech actions rely on common sensorimotor brain areas. They also suggest that visual processing of audible but not visible movements induces motor and visual mental simulation of the perceived actions to facilitate recognition and/or to learn the association between auditory and visual signals. ■

show abstract

Section: Visuo-lingual and Visuo-facial Speech Stimuli Share A Commonsupporting

confidence: 91%

Section: Motor Resonance Extends To Speech Actionmentioning

confidence: 92%

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Treille

Vilain

Hueber

et al. 2017

Journal of Cognitive Neuroscience

View full text Add to dashboard Cite

show abstract

“…Yet another possible link is that speech-specific perceptual problems in dyslexia are restricted to auditory-only speech as dyslexics may have learned to compensate for their auditory deficits by relying more on lipread input. This idea is in line with a report showing that dyslexics display enhanced brain activity in areas dedicated to visual-and motor-articulatory processes as compared to controls when presented with audiovisual speech (Pekkola et al, 2006).…”

Section: Phonetic Recalibration By Lipread Speech Has Been Demonstratsupporting

confidence: 91%

Phonetic Recalibration in Audiovisual Speech

Vroomen¹,

Baart²

2011

Frontiers in Neuroscience

View full text Add to dashboard Cite

“…In some previous studies, as in the case presented herein, the bilateral pSTS particularly failed to respond to congruency manipulation (Bushara et al, 2001;Miller and D'Esposito, 2005;Ojanen et al, 2005). In addition, other studies found a higher BOLD response to the incongruent condition vs. the congruent condition (Benoit et al,2010 ;Pekkola et al, 2006), or vice versa (Calvert et al, 2000;van Atteveldt et al, 2004;van Atteveldt et al, 2009; note that Calvert et al found only left pSTS activation). Therefore, the responsiveness of the bilateral pSTS to congruency remains unclear.…”

Section: Congruency Effectsmentioning

confidence: 92%

Neural correlates of audiovisual speech processing in a second language

et al. 2013

View full text Add to dashboard Cite

Abbreviations: L1 = native language, L2 = non-native language, pSTS = posterior superior temporal sulcus, STG = superior temporal gyrus, AV = audiovisual, AVc = audiovisual congruent, AVi = audiovisual incongruent, A = auditory, V = visual, B = baseline, MSI = multisensory interaction 2 AbstractNeuroimaging studies of audiovisual speech processing have exclusively addressed listeners' native language (L1). Yet, several behavioural studies now show that AV processing plays an important role in non-native (L2) speech perception. The current fMRI study measured brain activity during auditory, visual, audiovisual congruent and audiovisual incongruent utterances in L1 and L2. BOLD responses to congruent AV speech in the pSTS were stronger than in either unimodal condition in both L1 and L2. Yet no differences in AV processing were expressed according to the language background in this area. Instead, the regions in the bilateral occipital lobe had a stronger congruency effect on the BOLD response (congruent higher than incongruent) in L2 as compared to L1. According to these results, language background differences are predominantly expressed in these unimodal regions, whereas the pSTS is similarly involved in AV integration regardless of language dominance.

show abstract

Perception of matching and conflicting audiovisual speech in dyslexic and fluent readers: An fMRI study at 3 T

Cited by 90 publications

References 98 publications

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Phonetic Recalibration in Audiovisual Speech

Neural correlates of audiovisual speech processing in a second language

Contact Info

Product

Resources

About