Audiovisual Integration and Lipreading Abilities of Older Adults with Normal and Impaired Hearing

Tye‐Murray, Nancy; Sommers, Mitchell S.; Spehar, Brent

doi:10.1097/aud.0b013e31812f7185

Cited by 144 publications

(159 citation statements)

References 25 publications

Supporting

Mentioning

142

Contrasting

Unclassified

Order By: Relevance

“…9 We concluded, as did Cienkowski and Carney 8 in an earlier study, that age affects one's ability to lip-read (ie, to recognize speech using only the visual signal) but does not affect one's ability to integrate. Similarly, Tye-Murray et al 9 compared integration enhancement of a group of older participants with age-appropriate hearing loss to a group of older participants with normal hearing and found no difference in their integration abilities.…”

mentioning

confidence: 66%

“…The findings from both Sommers et al 3 and TyeMurray et al 9 have led us to reconceptualize how receivers might combine the auditory and visual speech signals. Perhaps there are no differences between older and younger persons' abilities to combine A and V information and no difference between older normal-hearing and hearing-impaired persons' abilities because there is no distinct integration stage as depicted in Figure 1.…”

mentioning

confidence: 99%

“…This has led to attempts to quantify integration ability and to experiments comparing the integration skills of different populations. 8,9 Perhaps the clearest attempt to quantify integration, independent of either A or V performance, is the Prelabeling (PRE) model developed by Braida. 10 The PRE model predicts AV performance from consonant confusion error patterns obtained with A and V presentations.…”

mentioning

confidence: 99%

See 2 more Smart Citations

Auditory and Visual Lexical Neighborhoods in Audiovisual Speech Perception

Tye‐Murray

Sommers

Spehar

2007

Trends in Amplification

Self Cite

View full text Add to dashboard Cite

formance in the AV condition for all 3 stimulus types surpassed what would be predicted by simply adding the scores obtained in the A and V conditions. On average, for example, the subjects recognized about 10% of the words in the Iowa Sentence Test 4 in a V condition, about 40% of the words in an A condition with a background of 6-talker babble, and nearly 80% of the words in an AV condition, also with a background of 6-talker babble. A similar superadditive effect was observed for the group of 44 older adults (ages 65 years and older) who were also included in the study and for the consonant and word tests.One reason for this superadditive effect is the complementary nature of the auditory and visual speech signals.1,5 For example, cues about nasality and voicing are typically conveyed very well by the auditory signal, even in adverse listening situations, whereas the visual signal does not convey them at all, even in the best of viewing conditions. On the other hand, cues about place of articulation are conveyed by the visual signal but not very well by a degraded M ost people, whether they have normal or impaired hearing, can recognize speech better when they can both see and hear the talker than when listening alone.1,2 Often, the advantage of supplementing listening with watching is more than additive. For instance, Sommers et al 3 tested 38 young adults (between the ages of 18 and 25 years) in an audition-only (A), vision-only (V), and audition-plus-vision (AV) condition with 3 stimuli types-consonants, words, and sentences. The perMuch evidence suggests that the mental lexicon is organized into auditory neighborhoods, with words that are phonologically similar belonging to the same neighborhood. In this investigation, we considered the existence of visual neighborhoods. When a receiver watches someone speak a word, a neighborhood of homophenes (ie, words that look alike on the face, such as pat and bat) is activated. The simultaneous activation of a word's auditory and visual neighborhoods may, in part, account for why individuals recognize speech better in an auditory-visual condition than what would be predicted by their performance in audition-only and vision-only conditions. A word test was administered to 3 groups of participants in audition-only, vision-only, and auditory-visual conditions, in the presence of 6-talker babble. Test words with sparse visual neighborhoods were recognized more accurately than words with dense neighborhoods in a vision-only condition. Densities of both the acoustic and visual neighborhoods as well as their intersection overlap were predictive of how well the test words were recognized in the auditory-visual condition. These results suggest that visual neighborhoods exist and that they affect auditory-visual speech perception. One implication is that in the presence of dual sensory impairment, the boundaries of both acoustic and visual neighborhoods may shift, adversely affecting speech recognition.

show abstract

mentioning

confidence: 66%

mentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

Auditory and Visual Lexical Neighborhoods in Audiovisual Speech Perception

Tye‐Murray

Sommers

Spehar

2007

Trends in Amplification

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, recent data suggest that hearing impairment in older adults is not necessarily associated with better AV integration abilities (Tye-Murray et al 2007). Here, we show degraded AV integration in older adults with HL relative to NHs in the same age group.…”

Section: Discussionmentioning

confidence: 99%

“…A recent study by Tye-Murray et al (2007) showed that older adults with mild HL could achieve levels of accuracy equal to those of NH controls for audiovisual (AV) speech perception in noise. Although this study is well founded and much needed, additional studies are needed to determine the variance and replicability of these results, especially in more typical listening environments.…”

Section: Introductionmentioning

confidence: 99%

Audiovisual Deficits in Older Adults with Hearing Loss: Biological Evidence

Musacchia

Arum²,

Nicol³

et al. 2009

Ear &Amp; Hearing

View full text Add to dashboard Cite

Objective:To examine the impact of hearing loss (HL) on audiovisual (AV) processing in the aging population. We hypothesized that agerelated HL would have a pervasive effect on sensory processing, extending beyond the auditory domain. Specifically, we predicted that decreased auditory input to the neural system, in the form of HL over time, would have deleterious effects on multisensory mechanisms. Design:This study compared AV processing between older adults with normal hearing (N ϭ 12) and older adults with mild to moderate sensorineural HL (N ϭ 12). To do this, we recorded cortical evoked potentials that were elicited by watching and listening to recordings of a speaker saying the syllable "bi." Stimuli were presented in three conditions: when hearing the syllable "bi" (auditory), when viewing a person say "bi" (visual), and when seeing and hearing the syllables simultaneously (AV). Presentation level of the auditory stimulus was set to ϩ30 dB SL for each listener to equalize auditory input across groups. Results:In the AV condition, the normal-hearing group showed a clear and consistent decrease in P1 and N1 latencies as well as a reduction in P1 amplitude compared with the sum of the unimodal components (auditory ϩ visual). These integration effects were absent or less consistent in HL participants.Conclusions: Despite controlling for auditory sensation level, visual influence on auditory processing was significantly less pronounced in HL individuals compared with controls, indicating diminished AV integration in this population. These results demonstrate that HL has a deleterious effect on how older adults combine what they see and hear. Although auditory amplification vastly improves the communication abilities in most HLs, the associated atrophy of multisensory mechanisms may contribute to a patient's difficulty in everyday settings. Our findings and related studies emphasize the potential value of multimodal tasks and stimuli in the assessment and rehabilitation of hearing impairments.

show abstract

Santa Claus, the Tooth Fairy, and Auditory‐Visual Integration

Sommers¹

2021

The Handbook of Speech Perception

View full text Add to dashboard Cite

Audiovisual Integration and Lipreading Abilities of Older Adults with Normal and Impaired Hearing

Cited by 144 publications

References 25 publications

Auditory and Visual Lexical Neighborhoods in Audiovisual Speech Perception

Auditory and Visual Lexical Neighborhoods in Audiovisual Speech Perception

Audiovisual Deficits in Older Adults with Hearing Loss: Biological Evidence

Santa Claus, the Tooth Fairy, and Auditory‐Visual Integration

Contact Info

Product

Resources

About