Speech Perception Without Traditional Speech Cues

Remez, Robert E.; Rubin, Philip E.; Pisoni, David B.; Carrell, Thomas D.

doi:10.1126/science.7233191

Cited by 694 publications

(542 citation statements)

References 8 publications

Supporting

Mentioning

522

Contrasting

Unclassified

Order By: Relevance

“…Of the three remaining conditions, there were 14 subjects in one (Video), 12 in the second (TonesF1F2F3Ffric), and 11 in the third (Video + TonesF1F2F3Ffric). A transcription provided by a participant in an audiovisual test was scored by tallying the percent of the syllables in each sentence that had been transcribed correctly (Remez et al, 1981).…”

Section: Resultsmentioning

confidence: 99%

“…In spite of the fact that a tonal analog of a speech signal is intelligible (Remez et al, 1981), it lacks the typical acoustic manifestations of natural vocal sound production. This fact arguably demonstrates the limitations of Gestalt-derived auditory accounts of perceptual organization, which describe the integration of sensory constituents based on their similarity (Bregman, 1990), and probabilistic accounts of speech perception, which describe the integration of signal elements based on likelihood (Massaro, 1994).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Multimodal perceptual organization of speech: Evidence from tone analogs of spoken utterances

Remez

Fellowes

Pisoni

et al. 1998

Speech Communication

View full text Add to dashboard Cite

Theoretical and practical motives alike have prompted recent investigations of multimodal speech perception. Theoretically, multimodal studies have extended the conceptualization of perceptual organization beyond the familiar modality-bound accounts deriving from Gestalt psychology. Practically, such investigations have been driven by a need to understand the proficiency of multimodal speech perception using an electrocochlear prosthesis for hearing. In each domain, studies have shown that perceptual organization of speech can occur even when the perceiver's auditory experience departs from natural speech qualities. Accordingly, our research examined auditor-visual multimodal integration of videotaped faces and selected acoustic constituents of speech signals, each realized as a single sinewave tone accompanying a video image of an articulating face. The single tone reproduced the frequency and amplitude of the phonatory cycle or of one of the lower three oral formants. Our results showed a distinct advantage for the condition pairing the video image of the face with a sinewave replicating the second formant, despite its unnatural timbre and its presentation in acoustic isolation from the rest of the speech signal. Perceptual coherence of multimodal speech in these circumstances is established when the two modalities concurrently specify the same underlying phonetic attributes.

show abstract

Section: Resultsmentioning

confidence: 99%

mentioning

confidence: 99%

Multimodal perceptual organization of speech: Evidence from tone analogs of spoken utterances

Remez

Fellowes

Pisoni

et al. 1998

Speech Communication

View full text Add to dashboard Cite

show abstract

“…One striking property that vocoded speech shares with other forms of artificially distorted speech (and speech in noise; Jacoby et al, 1988) such as sine-wave speech (Remez et al, 1981), as well as heavily accented speech, is that even while it is objectively unintelligible (such that few words can be spontaneously reported) the perceived intelligibility of the speech signal can be dramatically altered by information on the content of the sentence. This can be most clearly demonstrated by listening to a vocoded sentence immediately before and immediately after hearing the same sentence as clear speech.…”

Section: Experiments 2: Effects Of Feedback On Learning Vocoded Speechmentioning

confidence: 99%

“…Speech comprehension can be challenged by acoustic manipulations that affect spectral (Faulkner et al, 2000;Remez et al, 1981) or temporal (Mehler et al, 1993;Saberi & Perrott, 1999) properties of speech, or more simply by masking the speech signal with noise (G. A. Miller, Heise, & Lichten, 1951) or other speech sources (Cherry, 1953).…”

Section: Comparison With Other Forms Of Degraded Speechmentioning

confidence: 99%

Lexical Information Drives Perceptual Learning of Distorted Speech: Evidence From the Comprehension of Noise-Vocoded Sentences.

Davis¹,

Johnsrude²,

Hervais-Adelman³

et al. 2005

Journal of Experimental Psychology: General

445

576

View full text Add to dashboard Cite

Speech comprehension is resistant to acoustic distortion in the input, reflecting listeners' ability to adjust perceptual processes to match the speech input. For noise-vocoded sentences, a manipulation that removes spectral detail from speech, listeners' reporting improved from near 0% to 70% correct over 30 sentences (Experiment 1). Learning was enhanced if listeners heard distorted sentences while they knew the identity of the undistorted target (Experiments 2 and 3). Learning was absent when listeners were trained with nonword sentences (Experiments 4 and 5), although the meaning of the training sentences did not affect learning (Experiment 5). Perceptual learning of noise-vocoded speech depends on higher level information, consistent with top-down, lexically driven learning. Similar processes may facilitate comprehension of speech in an unfamiliar accent or following cochlear implantation.

show abstract

“…Here, we assessed degraded auditory perception and the effect of increasing acetylcholinesterase inhibition in patients with AD versus untreated healthy older people, using the classical paradigm of sinewave speech 11. Sinewave transformation reduces speech signals to a series of ‘whistles’ (corresponding to formant contours) from which spectral detail has been stripped.…”

Section: Introductionmentioning

confidence: 99%

Donepezil enhances understanding of degraded speech in Alzheimer's disease

Hardy

Hwang

Bond

et al. 2017

Ann Clin Transl Neurol

View full text Add to dashboard Cite

Auditory dysfunction under complex, dynamic listening conditions is a clinical hallmark of Alzheimer's disease (AD) but challenging to measure and manage. Here, we assessed understanding of sinewave speech (a paradigm of degraded speech perception) and general cognitive abilities in 17 AD patients, before and following a 10 mg dose of donepezil. Relative to healthy older individuals, patients had impaired sinewave speech comprehension that was selectively ameliorated by donepezil. Our findings demonstrate impaired perception of degraded speech in AD but retained perceptual learning capacity that can be harnessed by acetylcholinesterase inhibition, with implications for designing communication interventions and acoustic environments in dementia.

show abstract

Speech Perception Without Traditional Speech Cues

Cited by 694 publications

References 8 publications

Multimodal perceptual organization of speech: Evidence from tone analogs of spoken utterances

Multimodal perceptual organization of speech: Evidence from tone analogs of spoken utterances

Lexical Information Drives Perceptual Learning of Distorted Speech: Evidence From the Comprehension of Noise-Vocoded Sentences.

Donepezil enhances understanding of degraded speech in Alzheimer's disease

Contact Info

Product

Resources

About