Enhanced Visual Speech Perception in Individuals With Early-Onset Hearing Impairment

Auer, Edward T.; Bernstein, Lynne E.

doi:10.1044/1092-4388(2007/080)

Cited by 106 publications

(113 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Both analyses support the existence of a positive relationship between speechreading ability and acquisition of words via speech. The existence of such a relationship is consistent with the hypothesis that enhanced speechreading may be a result of more experience with processing visible speech (Auer & Bernstein, 2006;Bernstein et al, 2000;Tillberg, Ronnberg, Svard, & Ahlner, 1996). …”

supporting

confidence: 76%

“…Regression analysis led to three factors with a multiple R value of .77 for scores on speechreading sentences, which were (1) self ratings of success in understanding the speech of the general public, (2) use of speech for communication at home, and (3) English reading score. The first two factors suggest that the experience one has successfully communicating via speech is important, suggesting the possibility that, by virtue of their increased ability to speechread, some deaf individuals get more practice speechreading.Recently, Auer & Bernstein (2006) obtained further evidence of the association between speechreading ability and self-assessments of ability to communicate via spoken language with friends and with the general public. Specifically, speechreading accuracy for sentence length materials correlated with self-assessment of ability to understand friends speech (r = -.330), ability to understand the speech of the general public (r = -.303), ability of friends to understand your own speech (r = -.390); and ability of the general public to understand your own speech (r = -.412).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Estimating When and How Words Are Acquired: A Natural Experiment on the Development of the Mental Lexicon

Auer

Bernstein

2008

J Speech Lang Hear Res

Self Cite

View full text Add to dashboard Cite

Purpose-Sensitivity of subjective estimates of Age of Acquisition (AOA) and Acquisition Channel (AC) (printed, spoken, signed) to differences in word exposure within and between populations that differ dramatically in perceptual experience was examined.Methods-50 participants with early-onset deafness and 50 with normal hearing rated 175 words in terms of subjective age-of-acquisition and acquisition channel. Additional data were collected using a standardized test of reading and vocabulary.Results-Deaf participants rated words as learned later (M = 10 years) than did participants with normal hearing (M = 8.5 years) (F(1,99) = 28.59; p < .01). Group-averaged item ratings of AOA were highly correlated across the groups (r = .971), and with normative order of acquisition (deaf: r = .950 and hearing: r = .946). The groups differed in their ratings of acquisition channel: Hearing: printed = 30%, spoken = 70%, signed =0%; Deaf: printed = 45%, spoken = 38%, signed = 17%.Conclusions-Subjective AOA and AC measures are sensitive to between-and within-group differences in word experience. The results demonstrate that these subjective measures can be applied as reliable proxies for direct measures of lexical development in studies of lexical knowledge in adults with prelingual onset deafness.An individual adult's lexical knowledge is a function of that individual's psycholinguistic experience in interaction with biologically determined language processing factors. Various indices or measures of lexical knowledge have been demonstrated to be predictive of psycholinguistic functions, such as word acquisition, and the speed and ease of word recognition, naming, and recall. Some indices of lexical knowledge have involved attributes of words themselves, such as word length. Other indices of word knowledge are based on models of the mental lexicon, such as neighborhood density (Luce & Pisoni, 1998).Another type of index is a subjective estimate of an individual's experience with words, such as word familiarity (Auer, Bernstein, & Tucker, 2000a;Gernsbacher, 1984) and word age-ofacquisition (AOA) (K. J. Gilhooly & Logie, 1980). It is with the subjective measure of word AOA that this study is primarily concerned.1 Throughout this paper, the term "deaf" is applied to individuals with severe to profound hearing impairments (80 dB HL or greater 3-frequency pure tone average in the better ear) who rely primarily on vision for speech perception. These individuals may use hearing aids and gain benefit from residual hearing, but their primary source for language acquisition is vision. 2 In this group, hearing aids are typically used to enhance speechreading, not the other way around. NIH Public Access Subjective Measures of Lexical ExperienceOnce an individual has acquired a word, the AOA of that word is fixed is forever for that individual. This fact is of interest, because of the possibility that the individual's internal lexical context of word learning is itself important, and AOA has received considerable attention in the li...

show abstract

supporting

confidence: 76%

mentioning

confidence: 99%

Estimating When and How Words Are Acquired: A Natural Experiment on the Development of the Mental Lexicon

Auer

Bernstein

2008

J Speech Lang Hear Res

Self Cite

View full text Add to dashboard Cite

show abstract

“…Six participants (labeled as P1 to P6; mean age, 32 years; range, 22-43 years; 2 males), with normal hearing, normal or corrected-to-normal vision, English as a native language, and average or better lipreading (as determined using a screening procedure; Auer & Bernstein, 2007) were recruited. They gave informed consent and were paid $10/h.…”

Section: Experiments 1 Methodsmentioning

confidence: 99%

“…On the low side, lipreading accuracy has been reported to be approximately 10%-30% words correct in isolated sentences (e.g., Breeuwer & Plomp, 1986;Demorest & Bernstein, 1992;Rönnberg, 1995;Rön-nberg, Samuelsson, & Lyxell, 1998) and approximately 30%-60% phonemes correct in syllables (e.g., Fisher, 1968;Montgomery & Jackson, 1983;Owens & Blazek, 1985). On the other hand, congenitally deaf adults frequently demonstrate very good accuracy levels (Andersson & Lidestam, 2005;Auer & Bernstein, 2007;Auer, Bernstein, & Tucker, 2000;Bernstein, Auer, & Tucker, 2001;Bernstein, Demorest, & Tucker, 1998, 2000Mohammed et al, 2005). In a group of 72 deaf adults, the top quartile lip-read in the range of 65%-85% words correct on a set of isolated prerecorded sentences .…”

mentioning

confidence: 99%

See 1 more Smart Citation

Similarity structure in visual speech perception and optical phonetic signals

Jiang

Auer

Alwan

et al. 2007

Perception & Psychophysics

Self Cite

View full text Add to dashboard Cite

A complete understanding of visual phonetic perception (lipreading) requires linking perceptual effects to physical stimulus properties. However, the talking face is a highly complex stimulus, affording innumerable possible physical measurements. In the search for isomorphism between stimulus properties and phonetic effects, second-order isomorphism was examined between the perceptual similarities of video-recorded perceptually identified speech syllables and the physical similarities among the stimuli. Four talkers produced the stimulus syllables comprising 23 initial consonants followed by one of three vowels. Six normal-hearing participants identified the syllables in a visual-only condition. Perceptual stimulus dissimilarity was quantified using the Euclidean distances between stimuli in perceptual spaces obtained via multidimensional scaling. Physical stimulus dissimilarity was quantified using face points recorded in three dimensions by an optical motion capture system. The variance accounted for in the relationship between the perceptual and the physical dissimilarities was evaluated using both the raw dissimilarities and the weighted dissimilarities. With weighting and the full set of 3-D optical data, the variance accounted for ranged between 46% and 66% across talkers and between 49% and 64% across vowels. The robust second-order relationship between the sparse 3-D point representation of visible speech and the perceptual effects suggests that the 3-D point representation is a viable basis for controlled studies of first-order relationships between visual phonetic perception and physical stimulus attributes.

show abstract

Lipreading a naturalistic narrative in a female population: Neural characteristics shared with listening and reading

et al. 2022

View full text Add to dashboard Cite

Introduction: Few of us are skilled lipreaders while most struggle with the task. Neural substrates that enable comprehension of connected natural speech via lipreading are not yet well understood. Methods:We used a data-driven approach to identify brain areas underlying the lipreading of an 8-min narrative with participants whose lipreading skills varied extensively (range 6-100%, mean = 50.7%). The participants also listened to and read the same narrative. The similarity between individual participants' brain activity during the whole narrative, within and between conditions, was estimated by a voxel-wise comparison of the Blood Oxygenation Level Dependent (BOLD) signal time courses.Results: Inter-subject correlation (ISC) of the time courses revealed that lipreading, listening to, and reading the narrative were largely supported by the same brain areas in the temporal, parietal and frontal cortices, precuneus, and cerebellum. Additionally, listening to and reading connected naturalistic speech particularly activated higherlevel linguistic processing in the parietal and frontal cortices more consistently than lipreading, probably paralleling the limited understanding obtained via lip-reading. Importantly, higher lipreading test score and subjective estimate of comprehension of the lipread narrative was associated with activity in the superior and middle temporal cortex. Conclusions:Our new data illustrates that findings from prior studies using wellcontrolled repetitive speech stimuli and stimulus-driven data analyses are also valid for naturalistic connected speech. Our results might suggest an efficient use of brain areas dealing with phonological processing in skilled lipreaders.

show abstract

Enhanced Visual Speech Perception in Individuals With Early-Onset Hearing Impairment

Abstract: The present results are consistent with the results of Bernstein et al. (2000). The need to rely on visual speech throughout life, and particularly for the acquisition of spoken language by individuals with early-onset hearing loss, can lead to enhanced speechreading ability.

Cited by 106 publications

References 20 publications

Estimating When and How Words Are Acquired: A Natural Experiment on the Development of the Mental Lexicon

Estimating When and How Words Are Acquired: A Natural Experiment on the Development of the Mental Lexicon

Similarity structure in visual speech perception and optical phonetic signals

Lipreading a naturalistic narrative in a female population: Neural characteristics shared with listening and reading

Contact Info

Product

Resources

About