Integrating Voice Quality Cues in the Pitch Perception of Speech and Non-speech Utterances

Abstract

Pitch perception plays a crucial role in speech processing. Since F0 is highly ambiguous and variable in the speech signal, effective pitch-range perception is important in perceiving the intended linguistic pitch targets. This study argues that the effectiveness of pitch-range perception can be achieved by taking advantage of other signal-internal information that co-varies with F0, such as voice quality cues. This study provides direct perceptual evidence that voice quality cues as an indicator of pitch ranges can effectively affect the pitch-height perception. A series of forced-choice pitch classification experiments with four spectral conditions were conducted to investigate the degree to which manipulating spectral slope affects pitch-height perception. Both non-speech and speech stimuli were investigated. The results suggest that the pitch classification function is significantly shifted under different spectral conditions. Listeners are likely to perceive a higher pitch when the spectrum has higher high-frequency energy (i.e., tenser phonation). The direction of the shift is consistent with the correlation between voice quality and pitch range. Moreover, cue integration is affected by the speech mode, where listeners are more sensitive to relative difference within an utterance when hearing speech stimuli. This study generally supports the hypothesis that voice quality is an important enhancement cue for pitch range.

Going beyond F0: The acquisition of Mandarin tones

“…In Mandarin, native speakers exhibit heightened sensitivity to (Kreiman & Gerratt, 2010) and systematic use of (Keating & Esposito, 2007;Kuang, 2017) spectral cues such as H1-H2. More generally, spectral cues play an important role in pitch perception: manipulating spectral cues can significantly shift the perception of pitch height (Kuang & Liberman, 2018).…”

Target announcer voice detection by shcoolchildren of different psychophysiological status in case of vocal competition

“…При этом гендерных различий восприятия целевого слова, произнесенного мужским и женским голосом, не обнаружено: распределение доли правильных или ошибочных ответов и пропусков В настоящем исследовании выявлена связь между разделением испытуемых на группы с ПТСНС и ПТПНС, соответственно с повышенным и умеренным психоэмоциональным напряжением, и результатами слухового восприятия при выделении целевого голоса в условиях речевой конкуренции. Это подтвердило важную роль голосовых характеристик в распознавании речи, идентификации диктора и его эмоционального состояния, о котором свидетельствуют данные психофизических и электрофизиологических исследований, а также разработки автоматизированных систем распознавания речи и эмоций говорящего [16,28,30]. При этом зависимость от преобладания тонуса того или иного отдела вегетативной нервной системы была получена только в отношении целевого женского голоса.…”

Pitch Range and Voice Quality in Dimasa Focus Intonation

“…This study therefore addresses the role of voice quality in focus intonation, an area which has received very little attention in the literature. Previous studies (Kuang and Keating 2014;Kuang and Liberman 2018) have shown that voice quality plays a role in pitch range perception. This study shows from the perspective of production that pitch range differences at the level of intonation are accompanied by additional phonation differences.…”

“…Since tense and lax phonation (somehow) represent the continuum between the breathy and modal and creaky and modal ranges, it is expected that lax phonation will be associated with higher (and positive) spectral values when compared to its tense phonation counterparts. Previous studies have shown that when 'tense voice' Kuang and Liberman 2018) was used as stimuli, it was perceived as 'higher' in pitch. Listeners generally hear higher pitches when the spectrum includes more high-frequency energy (i.e., tenser phonation).…”