Speech perception without hearing

Abstract

In this study of visual phonetic speech perception without accompanying auditory speech stimuli, adults with normal hearing (NH; n = 96) and with severely to profoundly impaired hearing (IH;n = 72) identified consonant-vowel (CV)nonsense syllables and words in isolation and in sentences. The measures of phonetic perception were the proportion of phonemes correct and the proportion of transmitted feature information for CVs, the proportion of phonemes correct for words, and the proportion of phonemes correct and the amount of phoneme substitution entropy for sentences. The results demonstrated greater sensitivity to phonetic information in the IH group. Transmitted feature information was related to isolated word scores for the IH group, but not for the NH group. Phoneme errors in sentences were more systematic in the IH than in the NH group. Individual differences in phonetic perception for CVs were more highly associated with word and sentence performance for the IH than for the NH group. The results suggest that the necessity to perceive speech without hearing can be associated with enhanced visual phonetic perception in some individuals.Viewing a talker is generally thought to afford extremely impoverished phonetic information, even though visual speech stimuli are known to influence heard speech (see, e.g

Audiovisual spoken word recognition by children with cochlear implants

“…It has been hypothesized that visual cues enhance speech understanding because they provide segmental and suprasegmental information that is complementary (i.e., place of articulation) to the acoustic speech cues, and because they reduce the attentional demands placed on the auditory signal (8). Audiovisual spoken word recognition therefore appears to be more than the simple addition of auditory and visual information (9). A well-known example of the robustness of audiovisual spoken word recognition is the "McGurk" effect (10).…”

Is subjective word familiarity a meter of ambient language? A natural experiment on effects of perceptual experience

“…On the reading comprehension subtest, students read short passages and then answered multiple-choice questions. Previous research at GU in Bernstein, Demorest, and Tucker (2000) showed a significant positive correlation (r values between .26 and .40) between reading (as measured with the GU EPT) and lipreading performance in deaf adults with English as a first language. The vocabulary and reading comprehension subtests of the SAT-8 (Psychological Corporation, 1989) were substituted for the EPT measures at the CA sites and were administered to all participants.…”

The effect of varying talker identity and listening conditions on gaze behavior during audiovisual speech perception

“…Although a great deal of information can be gleaned from static faces, the motion of dynamic faces contains information about identity and emotion not present in static faces (Ambadar, Schooler & Cohn, 2005;Hill & Johnson, 2001;Knappmeyer, Thornton & Bülthoff, 2003;O'Toole, Roark, & Abdi, 2002;Lander & Bruce, 2000). Facial motion also contains linguistic information, as evidenced by the fact that silent speechreading is possible (Bernstein, Demorest & Tucker, 2000). Rarely though, is this visual speech information present in the complete absence of auditory speech information and audiovisual speech perception is the natural manner of communication.…”