Lip-Read Me Now, Hear Me Better Later

Rosenblum, Lawrence D.; Miller, Rachel M.; Sanchez, Kauyumari

doi:10.1111/j.1467-9280.2007.01911.x

Cited by 55 publications

(40 citation statements)

References 27 publications

(46 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This carryover effect may suggest that the talker-specific articulatory information available in the visible mouth can transfer to enhance phonetic convergence to that talker's auditory-only speech. This interpretation would be consistent with previous evidence from our lab illustrating that the learning involved in talker facilitation effects can transfer between modalities (Rosenblum et al, 2007;Sanchez et al, 2013). If visual influences can carry over to affect phonetic convergence to auditory-only stimuli, then we would expect to see such influences in the Experiment 1 noise group that shadowed audiovisual speech prior to shadowing auditory-only speech.…”

Section: Visible Articulation Enhances Phonetic Convergencesupporting

confidence: 89%

Visibility of speech articulation enhances auditory phonetic convergence

Dias

Rosenblum

2015

Atten Percept Psychophys

Self Cite

View full text Add to dashboard Cite

Talkers automatically imitate aspects of perceived speech, a phenomenon known as phonetic convergence. Talkers have previously been found to converge to auditory and visual speech information. Furthermore, talkers converge more to the speech of a conversational partner who is seen and heard, relative to one who is just heard (Dias & Rosenblum Perception, 40, 1457-1466, 2011. A question raised by this finding is what visual information facilitates the enhancement effect. In the following experiments, we investigated the possible contributions of visible speech articulation to visual enhancement of phonetic convergence within the noninteractive context of a shadowing task. In Experiment 1, we examined the influence of the visibility of a talker on phonetic convergence when shadowing auditory speech either in the clear or in low-level auditory noise. The results suggest that visual speech can compensate for convergence that is reduced by auditory noise masking. Experiment 2 further established the visibility of articulatory mouth movements as being important to the visual enhancement of phonetic convergence. Furthermore, the word frequency and phonological neighborhood density characteristics of the words shadowed were found to significantly predict phonetic convergence in both experiments. Consistent with previous findings (e.g., Goldinger Psychological Review, 105, 251-279, 1998), phonetic convergence was greater when shadowing low-frequency words. Convergence was also found to be greater for low-density words, contrasting with previous predictions of the effect of phonological neighborhood density on auditory phonetic convergence (e.g., Pardo, Jordan, Mallari, Scanlon, & Lewandowski Journal of Memory and Language, 69, 183-195, 2013). Implications of the results for a gestural account of phonetic convergence are discussed.

show abstract

Section: Visible Articulation Enhances Phonetic Convergencesupporting

confidence: 89%

Visibility of speech articulation enhances auditory phonetic convergence

Dias

Rosenblum

2015

Atten Percept Psychophys

Self Cite

View full text Add to dashboard Cite

show abstract

“…Interestingly, the findings of these two studies showed that the effect of audiovisual training on improving sentence comprehension in noise was independent of the idiosyncrasies of the talker’s articulation, as the talkers in the training and the HINT were not the same. This finding differs from cross-modal studies which have shown that familiarity with the talkers is a key factor in subsequent improvement in auditory speech processing (Rosenblum et al, 2007; von Kriegstein et al, 2008; Wu et al, 2013). Together, it seems that providing audiovisual training materials in a gating format is an efficient short-term approach in improving auditory speech-in-noise identification.…”

Section: Introductioncontrasting

confidence: 99%

The Efficacy of Short-term Gated Audiovisual Speech Training for Improving Auditory Sentence Identification in Noise in Elderly Hearing Aid Users

et al. 2017

View full text Add to dashboard Cite

This study aimed to examine the efficacy and maintenance of short-term (one-session) gated audiovisual speech training for improving auditory sentence identification in noise in experienced elderly hearing-aid users. Twenty-five hearing aid users (16 men and 9 women), with an average age of 70.8 years, were randomly divided into an experimental (audiovisual training, n = 14) and a control (auditory training, n = 11) group. Participants underwent gated speech identification tasks comprising Swedish consonants and words presented at 65 dB sound pressure level with a 0 dB signal-to-noise ratio (steady-state broadband noise), in audiovisual or auditory-only training conditions. The Hearing-in-Noise Test was employed to measure participants’ auditory sentence identification in noise before the training (pre-test), promptly after training (post-test), and 1 month after training (one-month follow-up). The results showed that audiovisual training improved auditory sentence identification in noise promptly after the training (post-test vs. pre-test scores); furthermore, this improvement was maintained 1 month after the training (one-month follow-up vs. pre-test scores). Such improvement was not observed in the control group, neither promptly after the training nor at the one-month follow-up. However, no significant between-groups difference nor an interaction between groups and session was observed. Conclusion: Audiovisual training may be considered in aural rehabilitation of hearing aid users to improve listening capabilities in noisy conditions. However, the lack of a significant between-groups effect (audiovisual vs. auditory) or an interaction between group and session calls for further research.

show abstract

“…A growing literature on perceptual learning shows that familiarity with specific voices has wide-ranging effects. These include helping infants isolate words in speech (Houston & Jusczyk, 2000; 2003), improving word perception (Nygaard & Pisoni, 1998; Nygaard et al, 1994; Yonan & Sommers, 2000), improving lip-reading (Rosenblum et al, 2007), changing sublexical processing (Allen & Miller, 2004; Eisner & McQueen, 2005; Kraljic & Samuel, 2005, 2007; Smith & Hawkins, 2012; Sumner, 2011; Sumner & Samuel, 2009; Theodore, Miller & DeSteno, 2009), and improving the ability to segregate overlapping voices (Johnsrude et al, 2013; Newman & Evers, 2007). Indexical variations in speech perception have wide-ranging effects on speech production, the phenomenon of phonetic convergence (or alignment ; Goldinger, 1998; Goldinger & Azuma, 2004; Namy et al, 2004; Nielsen, 2011; Pardo, 2006; Shockley et al, 2004; Smith & Hawkins, 2012).…”

Section: Discussionmentioning

confidence: 99%

Eye movements reveal fast, voice-specific priming.

Papesh¹,

Goldinger²,

Hout³

2016

Journal of Experimental Psychology: General

View full text Add to dashboard Cite

In spoken word perception, voice specificity effects are well-documented: When people hear repeated words in some task, performance is generally better when repeated items are presented in their originally heard voices, relative to changed voices. A key theoretical question about voice specificity effects concerns their time-course: Some studies suggest that episodic traces exert their influence late in lexical processing (the time-course hypothesis; McLennan & Luce, 2005), whereas others suggest that episodic traces influence immediate, online processing. We report two eye-tracking studies investigating the time-course of voice-specific priming within and across cognitive tasks. In Experiment 1, participants performed modified lexical decision or semantic classification to words spoken by four speakers. The tasks required participants to click a red “×” or a blue “+” located randomly within separate visual half-fields, necessitating trial-by-trial visual search with consistent half-field response mapping. After a break, participants completed a second block with new and repeated items, half spoken in changed voices. Voice effects were robust very early, appearing in saccade initiation times. Experiment 2 replicated this pattern while changing tasks across blocks, ruling out a response priming account. In the General Discussion, we address the time-course hypothesis, focusing on the challenge it presents for empirical disconfirmation, and highlighting the broad importance of indexical effects, beyond studies of priming.

show abstract

Lip-Read Me Now, Hear Me Better Later

Cited by 55 publications

References 27 publications

Visibility of speech articulation enhances auditory phonetic convergence

Visibility of speech articulation enhances auditory phonetic convergence

The Efficacy of Short-term Gated Audiovisual Speech Training for Improving Auditory Sentence Identification in Noise in Elderly Hearing Aid Users

Eye movements reveal fast, voice-specific priming.

Contact Info

Product

Resources

About