Speechreading Skill and Visual Movement Sensitivity are Related in Deaf Speechreaders

Mohammed, Tara; Campbell, Ruth; MacSweeney, Mairéad; Milne, Elizabeth; Hansen, P.; Coleman, Michael J.

doi:10.1068/p5211

Cited by 31 publications

(22 citation statements)

References 44 publications

(36 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Hearing-impaired listeners, especially with moderate to severe levels of impairment, rely heavily on visual cues in everyday life to compensate for the poorer speech intelligibility. The increased reliance may result in better use of visual cues and better integration of audio and visual speech (McGrath & Summerfield 1985;Mohammed et al 2005;Auer & Bernstein 2007;Tye-Murray et al 2007), even though hearing-impaired listeners have not always shown better lipreading skills than normal-hearing listeners (Lyxell & Rönnberg 1989). Due to the increased demand on the visual system, there could also be functional changes in the brain organization.…”

Section: Introductionmentioning

confidence: 96%

Audiovisual Asynchrony Detection and Speech Intelligibility in Noise With Moderate to Severe Sensorineural Hearing Impairment

Başkent¹,

Bazo

2011

Ear &Amp; Hearing

View full text Add to dashboard Cite

Contrary to either expectation per se, there was no indication of an effect of hearing impairment or age on the sensitivity to intermodal asynchrony in audiovisual speech. It is possible that the negative effects of aging were balanced with the positive effects of increased sensitivity due to reliance on visual cues with hearing impairment. The listeners, normal hearing or hearing impaired, who were more sensitive to asynchrony (with narrower synchrony windows) tended to understand speech in noise better, with both audio-only and audiovisual speech. The practical implication of the results is that delays in audio or video signals of communication systems would affect hearing-impaired listeners in a manner similar to normal-hearing listeners, and due to the importance of visual cues for the hearing-impaired listeners, special attention should be given to limit these delays.

show abstract

Section: Introductionmentioning

confidence: 96%

Audiovisual Asynchrony Detection and Speech Intelligibility in Noise With Moderate to Severe Sensorineural Hearing Impairment

Başkent¹,

Bazo

2011

Ear &Amp; Hearing

View full text Add to dashboard Cite

show abstract

“…However, the mechanisms responsible for such interindividual differences could be found at lower levels of visual processing. Previous literature suggests that observers that benefit the most from the visual speech information may have superior processing speed (Auer & Berstein, 1997;Feld & Sommers, 2009;Gagné et al, 2011) or superior sensitivity to visual movement (Armstrong, Neville, Hillyard, & Mitchell, 2002;Mohammed et al, 2005). Mohammed et al showed that the detection of coherent visible motion in random-dot kinematogram displays was related to speechreading skill in the best speechreaders (i.e., deaf participants).…”

Section: Visual Processing Mechanisms Supporting Av Spin Abilitymentioning

confidence: 99%

High visual resolution matters in audiovisual speech perception, but only for some

Alsius

Wayne

Paré

et al. 2016

Atten Percept Psychophys

View full text Add to dashboard Cite

The basis for individual differences in the degree to which visual speech input enhances comprehension of acoustically degraded speech is largely unknown. Previous research indicates that fine facial detail is not critical for visual enhancement when auditory information is available; however, these studies did not examine individual differences in ability to make use of fine facial detail in relation to audiovisual speech perception ability. Here, we compare participants based on their ability to benefit from visual speech information in the presence of an auditory signal degraded with noise, modulating the resolution of the visual signal through lowpass spatial frequency filtering and monitoring gaze behavior. Participants who benefited most from the addition of visual information (high visual gain) were more adversely affected by the removal of high spatial frequency information, compared to participants with low visual gain, for materials with both poor and rich contextual cues (i.e., words and sentences, respectively). Differences as a function of gaze behavior between participants with the highest and lowest visual gains were observed only for words, with participants with the highest visual gain fixating longer on the mouth region. Our results indicate that the individual variance in audiovisual speech in noise performance can be accounted for, in part, by better use of fine facial detail information extracted from the visual signal and increased fixation on mouth regions for short stimuli. Thus, for some, audiovisual speech perception may suffer when the visual input (in addition to the auditory signal) is less than perfect.

show abstract

“…For example, the information relative to place of articulation coding delivered through the CI is not accurate enough to distinguish words that differ only by the place of articulation, as "buck/duck." Thereby, the need for lipreading is increased (Giraud et al 2001), although many important components of speech articulation are not directly visible under normal circumstances (Mohammed et al 2005). Consequently, AV speech perception in CI users is a particularly interesting topic to investigate.…”

Section: Introductionmentioning

confidence: 99%

Degradation of Labial Information Modifies Audiovisual Speech Perception in Cochlear-Implanted Children

2013

View full text Add to dashboard Cite

Visual reduction led to an increase in the weight of audition, even in cochlear-implanted children, whose perception is generally dominated by vision. This result suggests that the natural bias in favor of vision is not immutable. Audiovisual speech integration partly depends on the experimental situation, which modulates the informational content of the sensory channels and the weight that is awarded to each of them. Consequently, participants, whether deaf with cochlear implants or having normal hearing, not only base their perception on the most reliable modality but also award it an additional weight.

show abstract

Speechreading Skill and Visual Movement Sensitivity are Related in Deaf Speechreaders

Cited by 31 publications

References 44 publications

Audiovisual Asynchrony Detection and Speech Intelligibility in Noise With Moderate to Severe Sensorineural Hearing Impairment

Audiovisual Asynchrony Detection and Speech Intelligibility in Noise With Moderate to Severe Sensorineural Hearing Impairment

High visual resolution matters in audiovisual speech perception, but only for some

Degradation of Labial Information Modifies Audiovisual Speech Perception in Cochlear-Implanted Children

Contact Info

Product

Resources

About