A glimpsing account for the benefit of simulated combined acoustic and electric hearing

Li, Ning; Loizou, Philipos C.

doi:10.1121/1.2839013

Cited by 60 publications

(74 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Second, harmonicity cues contained in the low-frequency acoustic signal may improve listeners' ability to segment syllable, word, and phrase boundaries, thereby helping them to accurately decode spectrally degraded signals from the CI ear (Spitzer et al, 2009;Zhang et al, 2010;Kong et al, 2015). As discussed by Li and Loizou (2008) and Dorman and Gifford (2008), low-frequency fine-structure cues improve listeners' access to robust acoustic landmarks (Stevens, 2002), such as the onset of voicing, that mark syllable structure and word boundaries. Third, a process known as "glimpsing" may contribute to EAS benefit when speech occurs in competing backgrounds (Cooke, 2006;Kong and Carlyon, 2007;Li and Loizou, 2008;Brown and Bacon, 2009a,b).…”

mentioning

confidence: 99%

“…As discussed by Li and Loizou (2008) and Dorman and Gifford (2008), low-frequency fine-structure cues improve listeners' access to robust acoustic landmarks (Stevens, 2002), such as the onset of voicing, that mark syllable structure and word boundaries. Third, a process known as "glimpsing" may contribute to EAS benefit when speech occurs in competing backgrounds (Cooke, 2006;Kong and Carlyon, 2007;Li and Loizou, 2008;Brown and Bacon, 2009a,b). When a competing signal is present, portions of the target speech are masked by the interfering sound, causing temporal and spectral interruptions in the audible speech stream.…”

mentioning

confidence: 99%

“…It is now widely accepted that electric-acoustic stimulation (EAS) in the form of bimodal hearing [cochlear implant (CI) supplemented by low-frequency acoustic hearing in the contralateral ear] or hybrid hearing (CI supplemented by low-frequency acoustic hearing preserved postoperatively in the same ear) has the potential to enhance speech understanding relative to a CI alone (see reviews by Gifford, 2008, 2010). This is especially true when the target speech signal occurs in the presence of competing maskers or background noise (e.g., real EAS users: Kong et al, 2005;Zhang et al, 2010;Carroll et al, 2011;Visram et al, 2012a,b;Neuman and Svirsky, 2013; simulated EAS listeners: Qin and Oxenham, 2006;Li and Loizou, 2008;Tillery et al, 2012).…”

mentioning

confidence: 99%

See 2 more Smart Citations

The role of continuous low-frequency harmonicity cues for interrupted speech perception in bimodal hearing

Donaldson

Kong

2016

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

Low-frequency acoustic cues have been shown to enhance speech perception by cochlear-implant users, particularly when target speech occurs in a competing background. The present study examined the extent to which a continuous representation of low-frequency harmonicity cues contributes to bimodal benefit in simulated bimodal listeners. Experiment 1 examined the benefit of restoring a continuous temporal envelope to the low-frequency ear while the vocoder ear received a temporally interrupted stimulus. Experiment 2 examined the effect of providing continuous harmonicity cues in the low-frequency ear as compared to restoring a continuous temporal envelope in the vocoder ear. Findings indicate that bimodal benefit for temporally interrupted speech increases when continuity is restored to either or both ears. The primary benefit appears to stem from the continuous temporal envelope in the low-frequency region providing additional phonetic cues related to manner and F1 frequency; a secondary contribution is provided by low-frequency harmonicity cues when a continuous representation of the temporal envelope is present in the low-frequency, or both ears. The continuous temporal envelope and harmonicity cues of low-frequency speech are thought to support bimodal benefit by facilitating identification of word and syllable boundaries, and by restoring partial phonetic cues that occur during gaps in the temporally interrupted stimulus.

show abstract

mentioning

confidence: 99%

mentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

The role of continuous low-frequency harmonicity cues for interrupted speech perception in bimodal hearing

Donaldson

Kong

2016

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

show abstract

“…Our results also showed that in quiet environments, for both CI and bimodal listening, adding low-frequency information to telephone speech makes no difference in terms of speech recognition, in contrast, extending high-frequency information to telephone speech significantly improved speech recognition. In noisy conditions, it is expected that bandwidth extension toward lower frequencies will benefit bimodal users due to the improved glimpsing and F0 representation facilitated by the use of an HA (Li & Loizou, 2008;Zhang et al, 2010a). The results of this study provide support for the design of algorithms that would extend higher frequency information, at least in quiet environments.…”

Section: Discussionmentioning

confidence: 56%

The Perception of Telephone-Processed Speech by Combined Electric and Acoustic Stimulation

Tahmina

Runge-Samuelson

et al. 2013

Trends in Amplification

View full text Add to dashboard Cite

This study assesses the effects of adding low-or high-frequency information to the band-limited telephone-processed speech on bimodal listeners' telephone speech perception in quiet environments. In the proposed experiments, bimodal users were presented under quiet listening conditions with wideband speech (WB), bandpass-filtered telephone speech (300-3,400 Hz, BP), high-pass filtered speech (f > 300 Hz, HP, i.e., distorted frequency components above 3,400 Hz in telephone speech were restored), and low-pass filtered speech (f < 3,400 Hz, LP, i.e., distorted frequency components below 300 Hz in telephone speech were restored). Results indicated that in quiet environments, for all four types of stimuli, listening with both hearing aid (HA) and cochlear implant (CI) was significantly better than listening with CI alone. For both bimodal and CI-alone modes, there were no statistically significant differences between the LP and BP scores and between the WB and HP scores. However, the HP scores were significantly better than the BP scores. In quiet conditions, both CI alone and bimodal listening achieved the largest benefits when telephone speech was augmented with high rather than low-frequency information. These findings provide support for the design of algorithms that would extend higher frequency information, at least in quiet environments.Keywords cochlear implant, bimodal hearing, bandwidth effect, electroacoustic stimulation, telephone speech For technological and economic reasons (e.g., to save the bandwidth of communication channels), the public telephone network only passes spectral information between 300 Hz and 3400 Hz. Thus, in telephone speech, lowfrequency information below 300 Hz and high-frequency information above 3400 Hz is mostly severely distorted. This bandwidth was selected according to the study on speech intelligibility by French and Steinberg (1947) for normal-hearing listeners. The band limiting poses only negligible challenges for listeners with normal hearing; however, the reduced spectral information can have negative impact on speech intelligibility for listeners with cochlear implants (CIs). Several previous studies (see, e.g., Cohen, Waltzman, & Shapiro, 1989;Cray et al., 2004;Fu & Galvin, 2006;Horng, Chen, Hsu, & Fu, 2007;Ito, Nakatake, & Fujita, 1999;Milchard & Cullington, 2004) evaluating conventional CI listeners' telephone usage have demonstrated that their recognition of telephone speech is significantly worse than their recognition of wideband speech, and it has been generally established that the reduced bandwidth of the telephone speech accounts for a significant amount of performance deterioration. These studies support the hypothesis that techniques to extend the bandwidth for telephone speech can potentially improve CI listeners' telephone speech perception. So far, only a few studies have examined bandwidth extension techniques for improving CI users' perception of telephone speech. For listeners who wear conventional CI devices, a recent study by Liu, Fu, and Nar...

show abstract

“…Although the score for the EAS setting in our experiment is close to scores reported by the other authors, the benefit observed is smaller. This is probably due to the larger number of channels in our CI simulation (which gives a better baseline performance for the CI only condition) and the use of babble noise instead of a single competing talker (which facilitates glimpsing the target, see Li and Loizou, 2008) of the other sex (which results in a very different F0 and an easier setting).…”

Section: A Benefit Of the Fundamental Frequency Cue In Simulated Easmentioning

confidence: 99%

Robustness against distortion of fundamental frequency cues in simulated electro-acoustic hearing

Vermeulen

Verschuur

2016

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

Speech recognition by cochlear implant users can be improved by adding an audible low frequency acoustic signal to electrical hearing; the resulting improvement is deemed "electroacoustic (EAS) benefit". We assessed the role of fundamental frequency (F0) information as a predictor of EAS benefit. Normal hearing listeners were presented with vocoded speech tokens with differing manipulations of the F0 signal, specifically: a pure tone with the correct mean F0 but with smaller variations around this mean (i.e. a smaller modulation depth), or a narrowband of white noise centered around F0, at varying bandwidths; a pure tone downshifted in frequency but keeping overall frequency modulations. Speech recognition thresholds significantly improved (p<0.05) when tones with reduced frequency modulation, or noise bands maintaining F0 information via their centre frequency were presented alongside the vocoded speech. Addition of a pure tone downshifted by 50 Hz or only a tone to indicate voicing, showed no significant EAS benefit. These results confirm that the presence of the target's F0 is beneficial for electro-acoustic hearing in a noisy environment and they indicate that the benefit is robust to a certain decrease in frequency selectivity, so long as mean F0 and frequency modulations of F0 are preserved.

show abstract

A glimpsing account for the benefit of simulated combined acoustic and electric hearing

Cited by 60 publications

References 39 publications

The role of continuous low-frequency harmonicity cues for interrupted speech perception in bimodal hearing

The role of continuous low-frequency harmonicity cues for interrupted speech perception in bimodal hearing

The Perception of Telephone-Processed Speech by Combined Electric and Acoustic Stimulation

Robustness against distortion of fundamental frequency cues in simulated electro-acoustic hearing

Contact Info

Product

Resources

About