The Perception-for-Action-Control Theory (PACT): A perceptuo-motor theory of speech perception

Abstract

It is an old-standing debate in the field of speech communication to determine whether speech perception involves auditory or multisensory representations and processing, independently on any procedural knowledge about the production of speech units or on the contrary if it is based on a recoding of the sensory input in terms of articulatory gestures, as posited in the Motor Theory of Speech Perception. The discovery of mirror neurons in the last 15 years has strongly renewed the interest for motor theories. However, while these neurophysiological data clearly reinforce the plausibility of the role of motor properties in perception, it could lead in our view to incorrectly deemphasise the role of perceptual shaping, crucial in speech communication. The so-called Perception-for-Action-Control Theory (PACT) aims at defining a theoretical framework connecting in a principled way perceptual shaping and motor procedural knowledge in speech multisensory processing in the human brain. In this paper, the theory is presented in details. It is described how this theory fits with behavioural and linguistic data, concerning firstly vowel systems in human languages, and secondly the perceptual organization of the speech scene. Finally a neurocomputational framework is presented in connection with recent data on the possible functional role of the motor system in speech perception.Keywords: perceptuo-motor interaction; speech perception; vowel perception; perceptual organisation; multisensory interactions; neurocomputational model; dorsal route IntroductionIt is an old-standing debate in the field of speech communication to determine whether speech perception involves auditory or multisensory representations and processing, independently on any procedural knowledge about the production of speech units (for a review, Diehl et al., 2004); or on the contrary if it is based on a recoding of the sensory input in terms of articulatory gestures, as posited in the Motor Theory of Speech Perception (Liberman et al., 1962;Liberman and Mattingly 1985;Liberman & Whalen, 2000). The discovery of mirror neurons (for reviews, Rizzolatti et al., 2001;Rizzolatti & Craighero, 2004) in the last 15 years has strongly renewed the interest for motor theories. However, while these neurophysiological data clearly reinforce the plausibility of the role of motor properties in perception, it could lead in our view to incorrectly deemphasise the role of perceptual shaping, crucial in speech communication. The so-called Perception-for-Action-Control Theory (PACT) aims at defining a theoretical framework connecting in a principled way perceptual shaping and motor procedural knowledge in speech multisensory processing in the human brain. In the following, the theory will be presented in details in Section I.Sections II and III will describe how this theory fits with behavioural and linguistic data, concerning firstly vowel systems in human languages, and secondly the perceptual organization of the speech scene. Section IV will consider a neuro-c...

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

“…In addition, repetitive and double-pulse TMS studies also suggest that speech motor regions are causally recruited during auditory speech categorization, especially in case of complex situations (e.g., the perception of acoustically ambiguous syllables or when phonological segmentation or working memory processes are strongly required; d'Ausilio, Bufalari, Salmas, & Fadiga, 2011;d'Ausilio et al, 2009;Möttönen & Watkins, 2009;Sato, Tremblay, & Gracco, 2009;Meister, Wilson, Deblieck, Wu, & Iacoboni, 2007). Taken together, these results support the idea that our motor knowledge used to produce speech sounds helps to partly constraint phonetic decoding of the sensory inputs, as proposed in motor and sensorimotor theories of speech perception and language comprehension (Pickering & Garrod, 2013;Schwartz, Ménard, Basirat, & Sato, 2012;Skipper, Van Wassenhove, Nussman, & Small, 2007;Liberman & Mattingly, 1985).…”

Autonomous Discovery of Motor Constraints in an Intrinsically Motivated Vocal Learner

“…To accomplish that objective, previously 187 proposed active learning architectures and the proprioceptive 188 feedback concept are combined. been corroborated by several experimental results [23], [24].…”

Somatosensory Event-related Potentials from Orofacial Skin Stretch Stimulation

“…There are long-standing interests in speech communication studies concerning the nature of representations and processing in speech production and perception [25][26][27] . The discovery of mirror neurons 28,29 reinforced the idea that motor functions are involved in speech perception.…”