Voicing influences the saliency of place of articulation in audio-visual speech perception in babble

Alm, Magnus; Behne, Dawn M.

doi:10.21437/interspeech.2008-699

Cited by 2 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In syllable initial position, articulators are less tense in the production of syllables with short VOT in comparison to syllables with long VOT which are also aspirated. Studies in audiovisual perception with diotic stimuli have shown higher identification and higher audiovisual integration of voiced syllables than voiceless syllables [5,38]. The present study observed that under dichotic AV listening conditions, a visual segment congruent to the auditory component presented to either ear increases correct identification of the respective auditory segment, and this influence of the visual segment overrides the otherwise observed right ear advantage.…”

Section: Discussionsupporting

confidence: 51%

See 1 more Smart Citation

Audiovisual Speech Perception in Diotic and Dichotic Listening Conditions

Vinay¹,

Nagaraj²

2022

J Hear Sci

View full text Add to dashboard Cite

Background: Speech perception is multisensory, relying on auditory as well as visual information from the articulators. Watching articulatory gestures which are either congruent or incongruent with the speech audio can change the auditory percept, indicating that there is a complex integration of auditory and visual stimuli. A speech segment is comprised of distinctive features, notably voice onset time (VOT) and place of articulation (POA). Understanding the importance of each of these features for audiovisual (AV) speech perception is critical. The present study investigated the perception of AV consonant-vowel (CV) syllables with various VOTs and POAs under two conditions: diotic incongruent and dichotic congruent.Material and methods: AV stimuli comprised diotic and dichotic CV syllables with stop consonants (bilabial /pa/ and /ba/; alveolar /ta/ and /da/; and velar /ka/ and /ɡa/) presented with congruent and incongruent video CV syllables with stop consonants. There were 40 righthanded normal hearing young adults (20 females, mean age 23 years, SD = 2.4 years) and 20 males (mean age 24 years, SD = 2.1 years) who participated in the experiment. Results:In the diotic incongruent AV condition, short VOT (voiced CV syllables) of the visual segments were identified when auditory segments had a CV syllable with long VOT (unvoiced CV syllables). In the dichotic congruent AV condition, there was an increase in identification of the audio segment when the subject was presented with a video segment congruent to either ear, in this way overriding the otherwise presented ear advantage in dichotic listening. Distinct visual salience of bilabial stop syllables had greater visual influence (observed as greater identification scores) than velar stop syllables and thus overrode the acoustic dominance of velar syllables. Conclusions:The findings of the present study have important implications for understanding the perception of diotic incongruent and dichotic congruent audiovisual CV syllables in which the stop consonants have different VOT and POA combinations. Earlier findings on the effect of VOT on dichotic listening can be extended to AV speech having dichotic auditory segments.

show abstract

Section: Discussionsupporting

confidence: 51%

“…In AV speech, fusion perception in incongruent AV conditions is more for voiced stop consonants than for unvoiced stops (in other words, stops with shorter VOT than longer VOT) [5]. Alm & Behne [38] attributed greater identification of POA of voiced stops compared to voiceless stops to the distinct spectral distribution of voiced stops.…”

Section: Introductionmentioning

confidence: 99%