Somatosensory contribution to audio-visual speech processing

Itō, Takayuki; Ohashi, Hiroki; Gracco, Vincent L.

doi:10.1016/j.cortex.2021.07.013

Cited by 3 publications

(2 citation statements)

References 62 publications

(83 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the case of the present study, since training with somatosensory stimulation was found to induce a change in the auditory category boundary, the interaction mechanism may be different than in auditory-visual speech perception. This would be consistent with a previous study which found that simultaneous somatosensory and visual stimulation in speech perception did not interact with one other in terms of the behavioral response ( Ito et al, 2021 ). Since somatosensory inputs to speech sounds affect the N1 peak in the auditory ERP ( Ito et al, 2014 ), which is considered to be associated with the initial extraction of vowel related information ( Näätänen and Picton, 1987 ), somatosensory inputs may affect the auditory processing of speech sounds at a lower level of vowel processing.…”

Section: Discussionsupporting

confidence: 93%

Repetitive Exposure to Orofacial Somatosensory Inputs in Speech Perceptual Training Modulates Vowel Categorization in Speech Perception

Itō

Ogane

2022

Front. Psychol.

Self Cite

View full text Add to dashboard Cite

Orofacial somatosensory inputs may play a role in the link between speech perception and production. Given the fact that speech motor learning, which involves paired auditory and somatosensory inputs, results in changes to speech perceptual representations, somatosensory inputs may also be involved in learning or adaptive processes of speech perception. Here we show that repetitive pairing of somatosensory inputs and sounds, such as occurs during speech production and motor learning, can also induce a change of speech perception. We examined whether the category boundary between /ε/ and /a/ was changed as a result of perceptual training with orofacial somatosensory inputs. The experiment consisted of three phases: Baseline, Training, and Aftereffect. In all phases, a vowel identification test was used to identify the perceptual boundary between /ε/ and /a/. In the Baseline and the Aftereffect phase, an adaptive method based on the maximum-likelihood procedure was applied to detect the category boundary using a small number of trials. In the Training phase, we used the method of constant stimuli in order to expose participants to stimulus variants which covered the range between /ε/ and /a/ evenly. In this phase, to mimic the sensory input that accompanies speech production and learning in an experimental group, somatosensory stimulation was applied in the upward direction when the stimulus sound was presented. A control group (CTL) followed the same training procedure in the absence of somatosensory stimulation. When we compared category boundaries prior to and following paired auditory-somatosensory training, the boundary for participants in the experimental group reliably changed in the direction of /ε/, indicating that the participants perceived /a/ more than /ε/ as a consequence of training. In contrast, the CTL did not show any change. Although a limited number of participants were tested, the perceptual shift was reduced and almost eliminated 1 week later. Our data suggest that repetitive exposure of somatosensory inputs in a task that simulates the sensory pairing which occurs during speech production, changes perceptual system and supports the idea that somatosensory inputs play a role in speech perceptual adaptation, probably contributing to the formation of sound representations for speech perception.

show abstract

Section: Discussionsupporting

confidence: 93%

Repetitive Exposure to Orofacial Somatosensory Inputs in Speech Perceptual Training Modulates Vowel Categorization in Speech Perception

Itō

Ogane

2022

Front. Psychol.

Self Cite

View full text Add to dashboard Cite

show abstract

“…It is important to differentiate the fibers connecting only the MGN and the HG from those that can get the STG, as they can have different purposes in the human brain (9). For example, Ito et al (36) reported that the STG might be involved in the joint processing of visual and auditory stimuli. Unlike XTRACT, the proposed methodology actively removes the fibers reaching the STG to target the core of the AR.…”

Section: Discussionmentioning

confidence: 99%

Automatic segmentation of the core of the acoustic radiation in humans

2022

View full text Add to dashboard Cite

IntroductionAcoustic radiation is one of the most important white matter fiber bundles of the human auditory system. However, segmenting the acoustic radiation is challenging due to its small size and proximity to several larger fiber bundles. TractSeg is a method that uses a neural network to segment some of the major fiber bundles in the brain. This study aims to train TractSeg to segment the core of acoustic radiation.MethodsWe propose a methodology to automatically extract the acoustic radiation from human connectome data, which is both of high quality and high resolution. The segmentation masks generated by TractSeg of nearby fiber bundles are used to steer the generation of valid streamlines through tractography. Only streamlines connecting the Heschl's gyrus and the medial geniculate nucleus were considered. These streamlines are then used to create masks of the core of the acoustic radiation that is used to train the neural network of TractSeg. The trained network is used to automatically segment the acoustic radiation from unseen images.ResultsThe trained neural network successfully extracted anatomically plausible masks of the core of the acoustic radiation in human connectome data. We also applied the method to a dataset of 17 patients with unilateral congenital ear canal atresia and 17 age- and gender-paired controls acquired in a clinical setting. The method was able to extract 53/68 acoustic radiation in the dataset acquired with clinical settings. In 14/68 cases, the method generated fragments of the acoustic radiation and completely failed in a single case. The performance of the method on patients and controls was similar.DiscussionIn most cases, it is possible to segment the core of the acoustic radiations even in images acquired with clinical settings in a few seconds using a pre-trained neural network.

show abstract

Towards a somatosensory theory of speech perception

Franken

Liu

Ostry

2022

Journal of Neurophysiology

View full text Add to dashboard Cite

Speech perception is known to be a multimodal process, relying not only on auditory input, but also on the visual system and possibly on the motor system as well. To date there has been little work on the potential involvement of the somatosensory system in speech perception. In the current review, we identify the somatosensory system as another contributor to speech perception. First, we argue that evidence in favor of a motor contribution to speech perception can just as easily be interpreted as showing somatosensory involvement. Second, physiological and neuroanatomical evidence for auditory-somatosensory interactions across the auditory hierarchy indicates the availability of a neural infrastructure that supports somatosensory involvement in auditory processing in general. Third, there is accumulating evidence for somatosensory involvement in the context of speech specifically. In particular, tactile stimulation modifies speech perception, and speech auditory input elicits activity in somatosensory cortical areas. Moreover, speech sounds can be decoded from activity in somatosensory cortex; lesions to this region affect perception, and vowels can be identified based on somatic input alone. We suggest the somatosensory involvement in speech perception derives from the somatosensory-auditory pairing which occurs during speech production and learning. By bringing together findings from a set of studies that have not been previously linked, the current paper identifies the somatosensory system as a presently unrecognized contributor to speech perception.

show abstract

Somatosensory contribution to audio-visual speech processing

Cited by 3 publications

References 62 publications

Repetitive Exposure to Orofacial Somatosensory Inputs in Speech Perceptual Training Modulates Vowel Categorization in Speech Perception

Repetitive Exposure to Orofacial Somatosensory Inputs in Speech Perceptual Training Modulates Vowel Categorization in Speech Perception

Automatic segmentation of the core of the acoustic radiation in humans

Towards a somatosensory theory of speech perception

Contact Info

Product

Resources

About