Recognition of asynchronous auditory-visual speech by younger and older listeners: A preliminary study

Gordon‐Salant, Sandra; Yeni‐Komshian, Grace H.; Fitzgibbons, Peter J.; Willison, Hannah M.; Freund, Maya S.

doi:10.1121/1.4992026

Cited by 8 publications

(12 citation statements)

References 35 publications

(34 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is therefore hypothesized that the AV speech integration window of older listeners will be narrower than that observed for younger listeners. This prediction is supported, in part, by previous findings that older listeners (both with and without hearing loss) demonstrated significant declines in speech recognition (relative to maximum performance) in most auditory lead/visual lag conditions, but younger listeners rarely showed a decrement in these conditions (Gordon-Salant et al, 2017). In that study, processing speed was identified as the principal cognitive factor contributing to the variance in AV speech recognition scores.…”

Section: Introductionsupporting

confidence: 74%

Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

et al. 2022

Self Cite

View full text Add to dashboard Cite

This investigation examined age-related differences in auditory-visual (AV) integration as reflected on perceptual judgments of temporally misaligned AV English sentences spoken by native English and native Spanish talkers. In the detection task, it was expected that slowed auditory temporal processing of older participants, relative to younger participants, would be manifest as a shift in the range over which participants would judge asynchronous stimuli as synchronous (referred to as the “AV simultaneity window”). The older participants were also expected to exhibit greater declines in speech recognition for asynchronous AV stimuli than younger participants. Talker accent was hypothesized to influence listener performance, with older listeners exhibiting a greater narrowing of the AV simultaneity window and much poorer recognition of asynchronous AV foreign-accented speech compared to younger listeners. Participant groups included younger and older participants with normal hearing and older participants with hearing loss. Stimuli were video recordings of sentences produced by native English and native Spanish talkers. The video recordings were altered in 50 ms steps by delaying either the audio or video onset. Participants performed a detection task in which they judged whether the sentences were synchronous or asynchronous, and performed a recognition task for multiple synchronous and asynchronous conditions. Both the detection and recognition tasks were conducted at the individualized signal-to-noise ratio (SNR) corresponding to approximately 70% correct speech recognition performance for synchronous AV sentences. Older listeners with and without hearing loss generally showed wider AV simultaneity windows than younger listeners, possibly reflecting slowed auditory temporal processing in auditory lead conditions and reduced sensitivity to asynchrony in auditory lag conditions. However, older and younger listeners were affected similarly by misalignment of auditory and visual signal onsets on the speech recognition task. This suggests that older listeners are negatively impacted by temporal misalignments for speech recognition, even when they do not notice that the stimuli are asynchronous. Overall, the findings show that when listener performance is equated for simultaneous AV speech signals, age effects are apparent in detection judgments but not in recognition of asynchronous speech.

show abstract

Section: Introductionsupporting

confidence: 74%

Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…The effect of aging on audiovisual gains in speech recognition is more complex, with no age-related changes evident when auditory and visual speech cues are clear and congruent ( Ballingham and Cienkowski, 2004 ; Sommers et al, 2005 ; Spehar et al, 2008 ; Gordon and Allen, 2009 ; Legault et al, 2010 ; Tye-Murray et al, 2010 ; Winneke and Phillips, 2011 ; Huyse et al, 2014 ; Smayda et al, 2016 ; Sommers and Phelps, 2016 ). However, audiovisual gains are reduced in older adults when auditory and visual speech cues are degraded ( Tye-Murray et al, 2008 , 2010 , 2011 ; Gordon and Allen, 2009 ; Huyse et al, 2014 ; Stevenson et al, 2015 ) or asynchronous ( Gordon-Salant et al, 2017 ).…”

Section: Age-related Changes In Audiovisual Temporal Perceptionmentioning

confidence: 99%

Audiovisual Temporal Perception in Aging: The Role of Multisensory Integration and Age-Related Sensory Loss

Brooks

Chan

Anderson

et al. 2018

Front. Hum. Neurosci.

View full text Add to dashboard Cite

Within each sensory modality, age-related deficits in temporal perception contribute to the difficulties older adults experience when performing everyday tasks. Since perceptual experience is inherently multisensory, older adults also face the added challenge of appropriately integrating or segregating the auditory and visual cues present in our dynamic environment into coherent representations of distinct objects. As such, many studies have investigated how older adults perform when integrating temporal information across audition and vision. This review covers both direct judgments about temporal information (the sound-induced flash illusion, temporal order, perceived synchrony, and temporal rate discrimination) and judgments regarding stimuli containing temporal information (the audiovisual bounce effect and speech perception). Although an age-related increase in integration has been demonstrated on a variety of tasks, research specifically investigating the ability of older adults to integrate temporal auditory and visual cues has produced disparate results. In this short review, we explore what factors could underlie these divergent findings. We conclude that both task-specific differences and age-related sensory loss play a role in the reported disparity in age-related effects on the integration of auditory and visual temporal information.

show abstract

“…Inhibitory control is an individual’s ability to disregard irrelevant stimuli in the presence of relevant incoming stimuli (Pichora-Fuller and Singh, 2006). Older adults also experience greater difficulty understanding words while simultaneously ignoring irrelevant or asynchronous stimuli presented through both auditory and visual media, thus demonstrating reduced inhibitory control compared to young adults (Dey and Sommers, 2015; Cohen and Gordon-Salant, 2017; Gordon-Salant et al, 2017). It is theorized that processing a degraded acoustic signal (as would occur with reduced audibility and/or imprecise auditory temporal processing) forces older adults to rely on cognition for speech understanding (Pichora-Fuller et al, 1995; Wingfield and Grossman, 2006).…”

Section: Introductionmentioning

confidence: 99%

Effects of Age, Cognition, and Neural Encoding on the Perception of Temporal Speech Cues

et al. 2019

Self Cite

View full text Add to dashboard Cite

Older adults commonly report difficulty understanding speech, particularly in adverse listening environments. These communication difficulties may exist in the absence of peripheral hearing loss. Older adults, both with normal hearing and with hearing loss, demonstrate temporal processing deficits that affect speech perception. The purpose of the present study is to investigate aging, cognition, and neural processing factors that may lead to deficits on perceptual tasks that rely on phoneme identification based on a temporal cue – vowel duration. A better understanding of the neural and cognitive impairments underlying temporal processing deficits could lead to more focused aural rehabilitation for improved speech understanding for older adults. This investigation was conducted in younger (YNH) and older normal-hearing (ONH) participants who completed three measures of cognitive functioning known to decline with age: working memory, processing speed, and inhibitory control. To evaluate perceptual and neural processing of auditory temporal contrasts, identification functions for the contrasting word-pair WHEAT and WEED were obtained on a nine-step continuum of vowel duration, and frequency-following responses (FFRs) and cortical auditory-evoked potentials (CAEPs) were recorded to the two endpoints of the continuum. Multiple linear regression analyses were conducted to determine the cognitive, peripheral, and/or central mechanisms that may contribute to perceptual performance. YNH participants demonstrated higher cognitive functioning on all three measures compared to ONH participants. The slope of the identification function was steeper in YNH than in ONH participants, suggesting a clearer distinction between the contrasting words in the YNH participants. FFRs revealed better response waveform morphology and more robust phase-locking in YNH compared to ONH participants. ONH participants also exhibited earlier latencies for CAEP components compared to the YNH participants. Linear regression analyses revealed that cortical processing significantly contributed to the variance in perceptual performance in the WHEAT/WEED identification functions. These results suggest that reduced neural precision contributes to age-related speech perception difficulties that arise from temporal processing deficits.

show abstract

Recognition of asynchronous auditory-visual speech by younger and older listeners: A preliminary study

Cited by 8 publications

References 35 publications

Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

Audiovisual Temporal Perception in Aging: The Role of Multisensory Integration and Age-Related Sensory Loss

Effects of Age, Cognition, and Neural Encoding on the Perception of Temporal Speech Cues

Contact Info

Product

Resources

About