Perceptual Doping: An Audiovisual Facilitation Effect on Auditory Speech Processing, From Phonetic Feature Extraction to Sentence Identification in Noise

Abstract

The findings of the present study support the perceptual doping hypothesis, as prior AV relative to A speech exposure resulted in a larger gain for the subsequent processing of speech stimuli. For complex speech stimuli that were presented in degraded listening conditions, a procedural learning effect (or a combination of procedural learning and perceptual learning effects) also facilitated the identification of speech stimuli, irrespective of whether the prior modality was A or AV.This is an open access article distributed under the Creative Commons Attribution License 4.0 (CCBY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Editorial: Cognitive hearing science: Investigating the relationship between selective attention and brain activity

“…This short-term alteration results in enhanced correlates of auditory selective spatial attention. Focusing on the very limited time necessary to improve neural and behavioral performance, the results by Hanenberg et al are in accord with the independent study of Moradi et al ( 2019 )—Brief exposure to audiovisual stimulus materials improves performance on auditory perception tasks. This finding generalizes to tasks ranging from the simple auditory gating of vowels and consonants to sentence perception in noise.…”

“…This finding generalizes to tasks ranging from the simple auditory gating of vowels and consonants to sentence perception in noise. Moradi et al ( 2019 ) dub this phenomenon “perceptual doping”. The brain seems to have the power to rapidly re-calibrate the perceptual systems dealing with speech.…”

The cognitive hearing science perspective on perceiving, understanding, and remembering language: The ELU model

“…Also related to RAMBPHO, we focused on a special form of priming. We dubbed the hypothesis “perceptual doping” ( Lidestam et al, 2014 ; Moradi et al, 2019 ). In brief, the priming effects of exposure to two initial conditions (auditory only, or audio-visually presented materials) on later auditory perception of consonants, vowels, and sentence materials generally demonstrated a multimodal facilitation (“doping”) effect.…”

“…This seems to be rather close to stream segregation, but the theoretical languages differ. By inference, postdiction may then calibrate the selection of the auditory object, comparable to “perceptual doping” ( Moradi et al, 2019 ).…”

Emotion Recognition of College Students Based on Audio and Video Image

“…Mel Frequency Cepstral Coefficients (MFCC), Linear Predictive Cepstral Coefficients Coefficient (LPCC), etc. are often used spectral feature parameters [12]. Prior to deep learning, which is constrained by algorithms, MFCC had a high degree of discrimination, making it the standard method for automatic voice recognition.…”