Audiovisual Speech Perception and Eye Gaze Behavior of Adults with Asperger Syndrome

Saalasti, Satu; Kätsyri, Jari; Tiippana, Kaisa; Laine-Hernandez, Mari; Wendt, Lennart von; Sams, Mikko

doi:10.1007/s10803-011-1400-0

Cited by 45 publications

(42 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In a separate pilot study (N = 14) we obtained similar results when we asked typical readers to report what they heard (instead of perceived). The rate of visual-based responses also exceeded the rate of fusion responses possibly because the visually presented /aka/ was clearly recognizable and thus did not support the /ata/ interpretation (see Tiippana, 2014, for a similar argument and, e.g., Andersen, Tiippana, Laarni, Kojo, & Sams, 2009;Saalasti et al, 2012, for similar patterns).…”

Section: Discussionmentioning

confidence: 99%

A General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia

Francisco

Jesse

Groen

et al. 2017

J Speech Lang Hear Res

View full text Add to dashboard Cite

Purpose Because reading is an audiovisual process, reading impairment may reflect an audiovisual processing deficit. The aim of the present study was to test the existence and scope of such a deficit in adult readers with dyslexia. Method We tested 39 typical readers and 51 adult readers with dyslexia on their sensitivity to the simultaneity of audiovisual speech and nonspeech stimuli, their time window of audiovisual integration for speech (using incongruent /aCa/ syllables), and their audiovisual perception of phonetic categories. Results Adult readers with dyslexia showed less sensitivity to audiovisual simultaneity than typical readers for both speech and nonspeech events. We found no differences between readers with dyslexia and typical readers in the temporal window of integration for audiovisual speech or in the audiovisual perception of phonetic categories. Conclusions The results suggest an audiovisual temporal deficit in dyslexia that is not specific to speech-related events. But the differences found for audiovisual temporal sensitivity did not translate into a deficit in audiovisual speech perception. Hence, there seems to be a hiatus between simultaneity judgment and perception, suggesting a multisensory system that uses different mechanisms across tasks. Alternatively, it is possible that the audiovisual deficit in dyslexia is only observable when explicit judgments about audiovisual simultaneity are required.

show abstract

Section: Discussionmentioning

confidence: 99%

A General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia

Francisco

Jesse

Groen

et al. 2017

J Speech Lang Hear Res

View full text Add to dashboard Cite

show abstract

“…The ability to match visual articulatory gestures with auditory speech information is one of the key skills necessary for successful audiovisual speech perception. This study may, therefore, serve as a baseline for evaluating the processing of facial articulatory movements in various populations for whom atypical audiovisual speech perception has been reported, such as autism (Foxe et al, 2013; Guiraud et al, 2012; Saalasti et al, 2012; Stevenson et al, 2014; Taylor, Isaac, & Milne, 2010), dyslexia (Bastien-Toniazzo, Stroumza, & Cavé, 2010), specific language impairment (Boliek, Keintz, Norrix, & Obrzut, 2010; Hayes, Tiippana, Nicol, Sams, & Kraus, 2003; Kaganovich, Schumaker, Macias, & Anderson, in press; Leybaert et al, 2014; Meronen, Tiippana, Westerholm, & Ahonen, 2013; Norrix, Plante, & Vance, 2006; Norrix, Plante, Vance, & Boliek, 2007), and phonological disorders (Dodd, McIntosh, Erdener, & Burnham, 2008). …”

Section: Discussionmentioning

confidence: 99%

Matching heard and seen speech: An ERP study of audiovisual word recognition

2016

View full text Add to dashboard Cite

Seeing articulatory gestures while listening to speech-in-noise (SIN) significantly improves speech understanding. However, the degree of this improvement varies greatly among individuals. We examined a relationship between two distinct stages of visual articulatory processing and the SIN accuracy by combining a cross-modal repetition priming task with ERP recordings. Participants first heard a word referring to a common object (e.g., pumpkin) and then decided whether the subsequently presented visual silent articulation matched the word they had just heard. Incongruent articulations elicited a significantly enhanced N400, indicative of a mismatch detection at the pre-lexical level. Congruent articulations elicited a significantly larger LPC, indexing articulatory word recognition. Only the N400 difference between incongruent and congruent trials was significantly correlated with individuals’ SIN accuracy improvement in the presence of the talker’s face.

show abstract

“…Reported differences in gaze to faces in children with ASD appear to vary depending on the age of the child (Dawson et al, 2005; Chawarska and Shic, 2009; Senju and Johnson, 2009). Moreover, recent work by Foxe et al (2013) suggests that multisensory integration deficits present in children with ASD may resolve in adulthood (although subtle differences may persist; Saalasti et al, 2012). …”

Section: Introductionmentioning

confidence: 99%

Seeing to hear? Patterns of gaze to speaking faces in children with autism spectrum disorders

Irwin

Brancazio

2014

Front. Psychol.

View full text Add to dashboard Cite

Using eye-tracking methodology, gaze to a speaking face was compared in a group of children with autism spectrum disorders (ASD) and a group with typical development (TD). Patterns of gaze were observed under three conditions: audiovisual (AV) speech in auditory noise, visual only speech and an AV non-face, non-speech control. Children with ASD looked less to the face of the speaker and fixated less on the speakers’ mouth than TD controls. No differences in gaze were reported for the non-face, non-speech control task. Since the mouth holds much of the articulatory information available on the face, these findings suggest that children with ASD may have reduced access to critical linguistic information. This reduced access to visible articulatory information could be a contributor to the communication and language problems exhibited by children with ASD.

show abstract

Audiovisual Speech Perception and Eye Gaze Behavior of Adults with Asperger Syndrome

Cited by 45 publications

References 41 publications

A General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia

A General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia

Matching heard and seen speech: An ERP study of audiovisual word recognition

Seeing to hear? Patterns of gaze to speaking faces in children with autism spectrum disorders

Contact Info

Product

Resources

About