Seeing and hearing others and oneself talk

Sams, Mikko; Möttönen, Riikka; Sihvonen, Toni

doi:10.1016/j.cogbrainres.2004.11.006

Cited by 106 publications

(99 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In Experiment 1 people heard more /A'bA/ when mouthing/imagining /A'bA/ and more /A'vA/ when mouthing/imagining /A'vA/. This replicates the perceptual capture effect reported in Sams et al for mouthing, 13 and extends the effect to pure inner speech.…”

Section: General Discussion and Conclusionsupporting

confidence: 76%

“…Sams et al have already demonstrated that silent articulation of syllables (which they assume engages auditory corollary-discharge) induces perceptual capture. 13 While Sams et al do not relate this to inner speech, silent articulation (mouthing) is a form of inner speech. In fact, inner speech exists on a continuum of articulator engagement: From "mouthing," where the articulators are moving fully (but silently), to "pure imagery" where the articulators remain still.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Inner speech captures the perception of external speech

Scott

Yeung

Gick

et al. 2013

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

Talking silently to ourselves occupies much of our mental lives, yet the mechanisms underlying this experience remain unclear. The following experiments provide behavioral evidence that the auditory content of inner speech is provided by corollary discharge. Corollary discharge is the motor system's prediction of the sensory consequences of its actions. This prediction can bias perception of other sensations, pushing percepts to match with prediction. The two experiments below show this bias induced by inner speech, demonstrating that inner speech causes external sounds to be heard as similar to the imagined speech, and that this bias operates on subphonemic content.

show abstract

Section: General Discussion and Conclusionsupporting

confidence: 76%

Section: Introductionmentioning

confidence: 99%

Inner speech captures the perception of external speech

Scott

Yeung

Gick

et al. 2013

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

show abstract

“…These results appear in keeping with the long-standing proposal that speech perception and speech production are closely linked processes, as first detailed in the motor theory of speech perception ͑Liberman et Liberman and Mattingly, 1985;Liberman and Whalen, 2000; see also Galantucci et al, 2006͒, itself an extension of earlier theories of perception in which motor actions were viewed as possible integral components of the perceptual process ͑Berke-ley, 1709; Washburn, 1926;Festinger et al, 1967͒. The findings also appear consistent with a growing number of behavioral, neuroimaging, and neurophysiological studies providing supporting evidence for sensorimotor interactions during both speech perception and production ͑Cooper and Lauritsen, 1974;Fadiga et al, 2002;Watkins et al, 2003;Wilson et al, 2004;Sams et al, 2005;Pulvermuller et al, 2006;Gentilucci and Bernardis, 2007;Meister et al, 2007;Skipper et al, 2007;Tourville et al, 2008͒. The results of the present study provide new behavioral evidence showing not only a link between the processes underlying speech perception and production, but a functional and plastic change involving both input and output processes simultaneously.…”

Section: Discussionsupporting

confidence: 74%

Perceptual recalibration of speech sounds following speech motor learning

Shiller

Sato

Gracco

et al. 2009

The Journal of the Acoustical Society of America

158

178

View full text Add to dashboard Cite

The functional sensorimotor nature of speech production has been demonstrated in studies examining speech adaptation to auditory and/or somatosensory feedback manipulations. These studies have focused primarily on flexible motor processes to explain their findings, without considering modifications to sensory representations resulting from the adaptation process. The present study explores whether the perceptual representation of the /s-b/ contrast may be adjusted following the alteration of auditory feedback during the production of /s/-initial words. Consistent with prior studies of speech adaptation, talkers exposed to the feedback manipulation were found to adapt their motor plans for /s/-production in order to compensate for the effects of the sensory perturbation. In addition, a shift in the /s-b/ category boundary was observed that reduced the functional impact of the auditory feedback manipulation by increasing the perceptual "distance" between the category boundary and subjects' altered /s/-stimuli-a pattern of perceptual adaptation that was not observed in two separate control groups. These results suggest that speech adaptation to altered auditory feedback is not limited to the motor domain, but rather involves changes in both motor output and auditory representations of speech sounds that together act to reduce the impact of the perturbation.

show abstract

“…Liberman & Mattingly (1985) proposed the motor theory of speech perception, pointing out the importance of act of speech in the perception of phonemes. Recently, Sams et al (2005) reported that a small degree of McGurk effect was observed when the subjects just silently articulated the syllables without any visual feedback. These studies suggest that there is a close relationship between the perception and production of speech, including the McGurk effect.…”

Section: Discussionmentioning

confidence: 99%

Fusion and combination in audio-visual integration

Omata

Masamune

2007

Proc. R. Soc. A.

View full text Add to dashboard Cite

Language is essentially multi-modal in its sensory origin, the daily conversation depending heavily on the audio-visual (AV) information. Although the perception of spoken language is primarily dominated by audition, the perception of facial expression, particularly that of the mouth, helps us comprehend speech. The McGurk effect is a striking phenomenon where the perceived phoneme is affected by the simultaneous observation of lip movement, and probably reflects the underlying AV integration process. The elucidation of the principles involved in this unique perceptual anomaly poses an interesting problem. Here we study the nature of the McGurk effect by means of neural networks (self-organizing maps, SOM) designed to extract patterns inherent in audio and visual stimuli. It is shown that a McGurk effect-like classification of incoming information occurs without any additional constraint or procedure added to the network, suggesting that the anomaly is a consequence of the AV integration process. Within this framework, an explanation is given for the asymmetric effect of AV pairs in causing the McGurk effect (fusion or combination) based on the 'distance' relationship between audio or visual information within the SOM. Our result reveals some generic features of the cognitive process of phoneme perception, and AV sensory integration in general.

show abstract

Seeing and hearing others and oneself talk

Cited by 106 publications

References 35 publications

Inner speech captures the perception of external speech

Inner speech captures the perception of external speech

Perceptual recalibration of speech sounds following speech motor learning

Fusion and combination in audio-visual integration

Contact Info

Product

Resources

About