Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds

Froyen, Dries; Atteveldt, Nienke van; Bonte, Milene; Blomert, Leo

doi:10.1016/j.neulet.2007.10.014

Cited by 104 publications

(195 citation statements)

References 17 publications

Supporting

Mentioning

166

Contrasting

Order By: Relevance

“…University (van Atteveldt et al, 2004(van Atteveldt et al, , 2007Blau et al, 2008;Froyen et al, 2008), as stated above, and they also agree with the anatomical examinations of the corresponding areas in macaque monkeys (Schroeder & Foxe, 2002;Schroeder et al, 2003).…”

Section: Applicationsupporting

confidence: 76%

A Self-Organized Artificial Neural Network Architecture for Sensory Integration with Applications to Letter-Phoneme Integration

2011

View full text Add to dashboard Cite

The multimodal self-organizing network (MMSON), an artificial neural network architecture carrying out sensory integration, is presented here. The architecture is designed using neurophysiological findings and imaging studies that pertain to sensory integration and consists of interconnected lattices of artificial neurons. In this artificial neural architecture, the degree of recognition of stimuli, that is, the perceived reliability of stimuli in the various subnetworks, is included in the computation. The MMSON's behavior is compared to aspects of brain function that deal with sensory integration. According to human behavioral studies, integration of signals from sensory receptors of different modalities enhances perception of objects and events and also reduces time to detection. In neocortex, integration takes place in bimodal and multimodal association areas and result, not only in feedback-mediated enhanced unimodal perception and shortened reaction time, but also in robust bimodal or multimodal percepts. Simulation data from the presented artificial neural network architecture show that it replicates these important psychological and neuroscientific characteristics of sensory integration.

show abstract

Section: Applicationsupporting

confidence: 76%

A Self-Organized Artificial Neural Network Architecture for Sensory Integration with Applications to Letter-Phoneme Integration

2011

View full text Add to dashboard Cite

show abstract

“…This cross-modal temporal deficit-reflected here as wider windows during which asynchronous events are perceived as synchronous -could result in impaired reading. Given that adequate associations between graphemes and phonemes occur in narrow time windows (Froyen et al, 2008), a cross-modal deficit that results in the widening of audiovisual temporal windows could impair the development of such associations and, as a consequence, reading-that is, it could hamper the formation of adequate representations, creating ambiguity in the correspondences between graphemes and phonemes (Wallace & Stevenson, 2014). This could result in reductions in the speed with which printed representations are decoded (Hairston et al, 2005) and lead to more errors in the accurate pairing of orthography and speech sounds (Hahn, Foxe, & Molholm, 2014).…”

Section: Discussionmentioning

confidence: 99%

“…As an alternative, readers with dyslexia may experience difficulties in the uptake of information and extend their temporal windows to compensate for the difficulties in sensory processing (see, for example, Diederich, Colonius, & Schomburg, 2008;Laurienti, Burdette, Maldjian, & Wallace, 2006, for a similar suggestion regarding older adults). Either way, the idea that abnormally wide temporal windows could result in deficits in processes that require narrow windows (i.e., reading; see Froyen, van Atteveldt, Bonte, & Blomert, 2008) warrants further investigation.…”

mentioning

confidence: 99%

A General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia

Francisco

Jesse

Groen

et al. 2017

J Speech Lang Hear Res

View full text Add to dashboard Cite

Purpose Because reading is an audiovisual process, reading impairment may reflect an audiovisual processing deficit. The aim of the present study was to test the existence and scope of such a deficit in adult readers with dyslexia. Method We tested 39 typical readers and 51 adult readers with dyslexia on their sensitivity to the simultaneity of audiovisual speech and nonspeech stimuli, their time window of audiovisual integration for speech (using incongruent /aCa/ syllables), and their audiovisual perception of phonetic categories. Results Adult readers with dyslexia showed less sensitivity to audiovisual simultaneity than typical readers for both speech and nonspeech events. We found no differences between readers with dyslexia and typical readers in the temporal window of integration for audiovisual speech or in the audiovisual perception of phonetic categories. Conclusions The results suggest an audiovisual temporal deficit in dyslexia that is not specific to speech-related events. But the differences found for audiovisual temporal sensitivity did not translate into a deficit in audiovisual speech perception. Hence, there seems to be a hiatus between simultaneity judgment and perception, suggesting a multisensory system that uses different mechanisms across tasks. Alternatively, it is possible that the audiovisual deficit in dyslexia is only observable when explicit judgments about audiovisual simultaneity are required.

show abstract

“…As previously argued, a general audiovisual deficit reflected in wider temporal windows of audiovisual processing (i.e., more in-synchrony responses, as shown in the present study) could result in impaired reading. Given that adequate associations between graphemes and phonemes occur in narrow time windows (Froyen et al, 2008), an audiovisual deficit that results in the widening of audiovisual temporal windows could impair the development of such associations and, consequently, reading. That is, it could hamper the formation of adequate representations, creating ambiguity in the correspondences between graphemes and phonemes (Wallace & Stevenson, 2014).…”

Section: Discussionmentioning

confidence: 99%

“…We and others (Hairston et al, 2005;Wallace & Stevenson, 2014) have argued that such an expanded time window could result in difficulties in processes that are dependent on the rapid and accurate integration of cues from multiple senses, such as reading (see Froyen, Van Atteveldt, Bonte, & Blomert, 2008). Expanding the temporal window over which auditory and visual events are seen as synchronous could result in inappropriate grapheme-phoneme correspondences and, consequently, in less efficient decoding.…”

Section: Introductionmentioning

confidence: 99%

Beyond the usual cognitive suspects: The importance of speechreading and audiovisual temporal sensitivity in reading ability

Francisco

Groen

Jesse³

et al. 2017

Learning and Individual Differences

View full text Add to dashboard Cite

The aim of this study was to clarify whether audiovisual processing accounted for variance in reading and reading-related abilities, beyond the effect of a set of measures typically associated with individual differences in both reading and audiovisual processing. Testing adults with and without a diagnosis of dyslexia, we showed that-across all participants, and after accounting for variance in cognitive abilities-audiovisual temporal sensitivity contributed uniquely to variance in reading errors. This is consistent with previous studies demonstrating an audiovisual deficit in dyslexia. Additionally, we showed that speechreading (identification of speech based on visual cues from the talking face alone) was a unique contributor to variance in phonological awareness in dyslexic readers only: those who scored higher on speechreading, scored lower on phonological awareness. This suggests a greater reliance on visual speech as a compensatory mechanism when processing auditory speech is problematic. A secondary aim of this study was to better understand the nature of dyslexia. The finding that a sub-group of dyslexic readers scored low on phonological awareness and high on speechreading is consistent with a hybrid perspective of dyslexia: There are multiple possible pathways to reading impairment, which may translate into multiple profiles of dyslexia.

show abstract

Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds

Cited by 104 publications

References 17 publications

A Self-Organized Artificial Neural Network Architecture for Sensory Integration with Applications to Letter-Phoneme Integration

A Self-Organized Artificial Neural Network Architecture for Sensory Integration with Applications to Letter-Phoneme Integration

A General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia

Beyond the usual cognitive suspects: The importance of speechreading and audiovisual temporal sensitivity in reading ability

Contact Info

Product

Resources

About