Voice Fundamental Frequency as an Auditory Supplement to the Speechreading of Sentences

Boothroyd, Arthur; Hnath-Chisolm, Theresa; Hanin, Laurie; Kishon‐Rabin, Liat

doi:10.1097/00003446-198812000-00006

Cited by 85 publications

(52 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The increase in manner of articulation is less intuitive. Previous studies have shown that F0 carries manner information during normal acoustic listening scenarios (e.g., Breeuwer and Plomp, 1986;Boothroyd, 1988;Faulkner and Rosen, 1999), but to the authors' knowledge the present study is the first to explicitly demonstrate that an acoustic representation of F0 enhances manner perception for EAS users. To examine the effects of the T F0-env signal on manner in greater detail, IT analysis was conducted using the actual bimodal group consonant confusion matrices (0 dB SNR) with manner of articulation separated into its main binary features (plosive, fricative, affricate, nasal, and glide).…”

Section: B the Role Of F0 In Bimodal Consonant Perceptioncontrasting

confidence: 48%

The relative phonetic contributions of a cochlear implant and residual acoustic hearing to bimodal speech perception

Sheffield

Zeng

2012

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

The addition of low-passed (LP) speech or even a tone following the fundamental frequency (F0) of speech has been shown to benefit speech recognition for cochlear implant (CI) users with residual acoustic hearing. The mechanisms underlying this benefit are still unclear. In this study, eight bimodal subjects (CI users with acoustic hearing in the non-implanted ear) and eight simulated bimodal subjects (using vocoded and LP speech) were tested on vowel and consonant recognition to determine the relative contributions of acoustic and phonetic cues, including F0, to the bimodal benefit. Several listening conditions were tested (CI/Vocoder, LP, T F0-env , CI/Vocoder þ LP, CI/Vocoder þ T F0-env ). Compared with CI/Vocoder performance, LP significantly enhanced both consonant and vowel perception, whereas a tone following the F0 contour of target speech and modulated with an amplitude envelope of the maximum frequency of the F0 contour (T F0-env ) enhanced only consonant perception. Information transfer analysis revealed a dual mechanism in the bimodal benefit: The tone representing F0 provided voicing and manner information, whereas LP provided additional manner, place, and vowel formant information. The data in actual bimodal subjects also showed that the degree of the bimodal benefit depended on the cutoff and slope of residual acoustic hearing.

show abstract

Section: B the Role Of F0 In Bimodal Consonant Perceptioncontrasting

confidence: 48%

The relative phonetic contributions of a cochlear implant and residual acoustic hearing to bimodal speech perception

Sheffield

Zeng

2012

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

show abstract

“…F0 has been shown to be important for several linguistic cues, including consonant voicing ͑Boothroyd et al., 1988;Holt et al, 2001͒, lexical boundaries ͑Spitzer et al, 2007͒, and contextual emphasis ͑Fry, 1955͒ as well as manner ͑Faulkner and Rosen, 1999͒. It is unclear, however, to what extent any of these linguistic cues may have contributed to the simulated EAS effects observed here.…”

Section: Explaining the Benefits Of Easmentioning

confidence: 99%

Low-frequency speech cues and simulated electric-acoustic hearing

Brown

Bacon

2009

The Journal of the Acoustical Society of America

140

View full text Add to dashboard Cite

The addition of low-frequency acoustic information to real or simulated electric stimulation ͑so-called electric-acoustic stimulation or EAS͒ often results in large improvements in intelligibility, particularly in competing backgrounds. This may reflect the availability of fundamental frequency ͑F0͒ information in the acoustic region. The contributions of F0 and the amplitude envelope ͑as well as voicing͒ of speech to simulated EAS was examined by replacing the low-frequency speech with a tone that was modulated in frequency to track the F0 of the speech, in amplitude with the envelope of the low-frequency speech, or both. A four-channel vocoder simulated electric hearing. Significant benefit over vocoder alone was observed with the addition of a tone carrying F0 or envelope cues, and both cues combined typically provided significantly more benefit than either alone. The intelligibility improvement over vocoder was between 24 and 57 percentage points, and was unaffected by the presence of a tone carrying these cues from a background talker. These results confirm the importance of the F0 of target speech for EAS ͑in simulation͒. They indicate that significant benefit can be provided by a tone carrying F0 and amplitude envelope cues. The results support a glimpsing account of EAS and argue against segregation.

show abstract

“…They all belonged to the age group of young adults, between 19 and 41 years old, in order to control age-related changes, which affect cognitive and linguistic abilities (Bergman, 1980). The main factors that influence speech-reading are: level of hearing (Erber, 1982), sight (Jeffers & Barley, 1978), age (Bergman, 1980), ability to synthesize the cues (Jeffers & Barley, 1978;Golan, 1995), psychological and cultural aspects (Sekiyama, 1997;Sekiyama & Tohkura, 1993), as well as level of proficiency in the language (Boothroyd, 1988).…”

Section: The Participantsmentioning

confidence: 99%

“…T he sentences that were used as test data are based on CUNY -topic related sentences (Boothroyd, Hnath-Chisolm, Hanin, & Kishon-Rabin, 1988), which are lists of simple sentences that are frequently used in speech perception research. T here were six lists consisting of 12 sentences, and each simulation set included all those lists in different auditory stimulation conditions.…”

Section: The Experiments Design and Proceduresmentioning

confidence: 99%

An Attention Economy Perspective on the Effectiveness of Incomplete Information

Geri

Neumann²,

Schocken³

et al. 2008

InformingSciJ

View full text Add to dashboard Cite

This study suggests an attention economy perspective on incomplete information, asserting that people use partial information as basis for action, hence an effective information system should provide them just with the most useful partial information, and should avoid redundant information that wastes their limited attention resources. These assertions were empirically examined via simulation of a speech-reading process that measured the real and perceived value of two levels of partial speech-reading support. The findings indicate that additional partial information improved performance, but there was practically no significant difference between one and two signals support levels. High correlation was found between the different methods of evaluation, suggesting that perceived value may be used as substitute to real value measurement after considering the circumstances of the system involved. T his research may provide important insights for designing information systems in general, as well as speech-reading support systems that will improve communication opportunities of hearing impaired people.

show abstract

Voice Fundamental Frequency as an Auditory Supplement to the Speechreading of Sentences

Cited by 85 publications

References 0 publications

The relative phonetic contributions of a cochlear implant and residual acoustic hearing to bimodal speech perception

The relative phonetic contributions of a cochlear implant and residual acoustic hearing to bimodal speech perception

Low-frequency speech cues and simulated electric-acoustic hearing

An Attention Economy Perspective on the Effectiveness of Incomplete Information

Contact Info

Product

Resources

About