Speech listening entails neural encoding of invisible articulatory features

Pastore, Aldo; Tomassini, Alice; Delis, Ioannis; Dolfini, Elisa; Fadiga, Luciano; D’Ausilio, Alessandro

doi:10.1016/j.neuroimage.2022.119724

Cited by 3 publications

(2 citation statements)

References 106 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This is further evidenced by the comparison between cross correlation tables in figure 5(h) and in figure 5(i), built on I out profiles resulting from MFCCs-derived and EMA-derived input sequences, respectively, which show much higher correlation (i.e. poorer distinction) between I out profiles resulting from audio classification with respect to those coming from classification of kinematic data, well in accordance with previous literature on speech recognition [32].…”

Section: Resultssupporting

confidence: 88%

“…From the high-dimensional EMA data (comprising 7 sensors × 3 dimensions = 21 time-series), only the three most relevant recordings [32] were chosen: namely tongue movement towards and away-from the lips (TB.x) and the palate (TB.z), and finally opening and closing of the mouth (lower lip moving towards and away from the upper lip: LL.z) (figure 5(a)). Figure S4 in the supporting information shows the entire dataset.…”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

An organic artificial soma for spatio-temporal pattern recognition via dendritic integration

Di Lauro,

Rondelli,

De Salvo

et al. 2024

Neuromorph. Comput. Eng.

View full text Add to dashboard Cite

A novel organic neuromorphic device performing pattern classification is presented and demonstrated. It features an artificial soma capable of dendritic integration from three pre-synaptic neurons. The time response of the interface between electrolytic solutions and organic mixed ionic-electronic conductors is proposed as the sole computational feature for pattern recognition, and it is easily tuned in the organic dendritic integrator by simply controlling electrolyte ionic strength. The classifier is benchmarked in speech-recognition experiments, with a sample of fourteen words, encoded either from audio tracks or from kinematic data, showing excellent discrimination performances in a planar, miniaturizable, fully passive device, designed to be promptly integrated in more complex architectures where on-board pattern classification is required.

show abstract

Section: Resultssupporting

confidence: 88%

Section: Resultsmentioning

confidence: 99%

An organic artificial soma for spatio-temporal pattern recognition via dendritic integration

Di Lauro,

Rondelli,

De Salvo

et al. 2024

Neuromorph. Comput. Eng.

View full text Add to dashboard Cite

show abstract

Speech perception difficulty modulates theta-band encoding of articulatory synergies

Corsini,

Tomassini,

Pastore

et al. 2024

Journal of Neurophysiology

View full text Add to dashboard Cite

The human brain tracks available speech acoustics and extrapolates missing information such as the speaker's articulatory patterns. However, the extent to which articulatory reconstruction supports speech perception remains unclear. This study explores the relationship between articulatory reconstruction and task difficulty. Participants listened to sentences and performed a speech-rhyming task. Real kinematic data of the speaker's vocal tract were recorded via electromagnetic articulography (EMA) and aligned to corresponding acoustic outputs. We extracted articulatory synergies from the EMA data using Principal Component Analysis (PCA) and employed Partial Information Decomposition (PID) to separate the electroencephalographic (EEG) encoding of acoustic and articulatory features into unique, redundant, and synergistic atoms of information. We median-split sentences into easy (ES) and hard (HS) based on participants' performance and found that greater task difficulty involved greater encoding of unique articulatory information in the theta band. We conclude that fine-grained articulatory reconstruction plays a complementary role in the encoding of speech acoustics, lending further support to the claim that motor processes support speech perception.

show abstract

Automatic imitation of speech is enhanced for non-native sounds

Wilt,

Wu,

Evans

et al. 2023

Psychon Bull Rev

View full text Add to dashboard Cite

Simulation accounts of speech perception posit that speech is covertly imitated to support perception in a top-down manner. Behaviourally, covert imitation is measured through the stimulus-response compatibility (SRC) task. In each trial of a speech SRC task, participants produce a target speech sound whilst perceiving a speech distractor that either matches the target (compatible condition) or does not (incompatible condition). The degree to which the distractor is covertly imitated is captured by the automatic imitation effect, computed as the difference in response times (RTs) between compatible and incompatible trials. Simulation accounts disagree on whether covert imitation is enhanced when speech perception is challenging or instead when the speech signal is most familiar to the speaker. To test these accounts, we conducted three experiments in which participants completed SRC tasks with native and non-native sounds. Experiment 1 uncovered larger automatic imitation effects in an SRC task with non-native sounds than with native sounds. Experiment 2 replicated the finding online, demonstrating its robustness and the applicability of speech SRC tasks online. Experiment 3 intermixed native and non-native sounds within a single SRC task to disentangle effects of perceiving non-native sounds from confounding effects of producing non-native speech actions. This last experiment confirmed that automatic imitation is enhanced for non-native speech distractors, supporting a compensatory function of covert imitation in speech perception. The experiment also uncovered a separate effect of producing non-native speech actions on enhancing automatic imitation effects.

show abstract

Speech listening entails neural encoding of invisible articulatory features

Cited by 3 publications

References 106 publications

An organic artificial soma for spatio-temporal pattern recognition via dendritic integration

An organic artificial soma for spatio-temporal pattern recognition via dendritic integration

Speech perception difficulty modulates theta-band encoding of articulatory synergies

Automatic imitation of speech is enhanced for non-native sounds

Contact Info

Product

Resources

About