The effect of affect on various acoustic measures of prosody in tone and non-tone languages: A comparison based on computer analysis of voice

Ross, Elliott D.; Edmondson, Jerold A.; Seibert, G. Burton

doi:10.1016/s0095-4470(19)30669-2

Cited by 74 publications

(40 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…, 1985). Importantly, fundamental frequency remains following low‐pass filtering procedures and it is this feature of speech that is considered the most crucial prosodic cue (Ross et al. , 1986).…”

Section: Methodsmentioning

confidence: 99%

How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico‐semantic cues

Mitchell

2006

Eur J of Neuroscience

View full text Add to dashboard Cite

We frequently encounter conflicting emotion cues. This study examined how the neural response to emotional prosody differed in the presence of congruent and incongruent lexico-semantic cues. Two hypotheses were assessed: (i) decoding emotional prosody with conflicting lexico-semantic cues would activate brain regions associated with cognitive conflict (anterior cingulate and dorsolateral prefrontal cortex) or (ii) the increased attentional load of incongruent cues would modulate the activity of regions that decode emotional prosody (right lateral temporal cortex). While the participants indicated the emotion conveyed by prosody, functional magnetic resonance imaging data were acquired on a 3T scanner using blood oxygenation level-dependent contrast. Using SPM5, the response to congruent cues was contrasted with that to emotional prosody alone, as was the response to incongruent lexico-semantic cues (for the 'cognitive conflict' hypothesis). The right lateral temporal lobe region of interest analyses examined modulation of activity in this brain region between these two contrasts (for the 'prosody cortex' hypothesis). Dorsolateral prefrontal and anterior cingulate cortex activity was not observed, and neither was attentional modulation of activity in right lateral temporal cortex activity. However, decoding emotional prosody with incongruent lexico-semantic cues was strongly associated with left inferior frontal gyrus activity. This specialist form of conflict is therefore not processed by the brain using the same neural resources as non-affective cognitive conflict and neither can it be handled by associated sensory cortex alone. The recruitment of inferior frontal cortex may indicate increased semantic processing demands but other contributory functions of this region should be explored.

show abstract

Section: Methodsmentioning

confidence: 99%

How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico‐semantic cues

Mitchell

2006

Eur J of Neuroscience

View full text Add to dashboard Cite

show abstract

“…Indeed, several studies showed that acoustic properties of speech vary with respect to the emotional quality, intensity, and context (e.g., Bachorowski & Owren, 1995). Furthermore, studies of emotion encoding in voice from a crosscultural perspective (comparing tonal and nontonal languages) found that fundamental frequency and speech rate were used in different ways by speakers of different cultures (Anolli, Wang, Mantovani, & De Toni, 2008; Ross, Edmondson, & Seibert, 1986). This finding confirms that vocal expression does not exclusively signal physiological arousal but also qualitative and culturally sensitive differences between emotions.…”

Section: Empirical Findingsmentioning

confidence: 99%

In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion

Scherer¹,

Clark-Polner²,

Mortillaro³

2011

Int J Psychol

223

147

View full text Add to dashboard Cite

Do members of different cultures express (or ''encode'') emotions in the same fashion? How well can members of distinct cultures recognize (or ''decode'') each other's emotion expressions? The question of cultural universality versus specificity in emotional expression has been a hot topic of debate for more than half a century, but, despite a sizeable amount of empirical research produced to date, no convincing answers have emerged. We suggest that this unsatisfactory state of affairs is due largely to a lack of concern with the precise mechanisms involved in emotion expression and perception, and propose to use a modified Brunswikian lens model as an appropriate framework for research in this area. On this basis we provide a comprehensive review of the existing literature and point to research paradigms that are likely to provide the evidence required to resolve the debate on universality vs. cultural specificity of emotional expression. Applying this fresh perspective, our analysis reveals that, given the paucity of pertinent data, no firm conclusions can be drawn on actual expression (encoding) patterns across cultures (although there appear to be more similarities than differences), but that there is compelling evidence for intercultural continuity in decoding, or recognition, ability. We also note a growing body of research on the notion of ingroup advantage due to expression ''dialects,'' above and beyond the general encoding or decoding patterns. We furthermore suggest that these empirical patterns could be explained by both universality in the underlying mechanisms and cultural specificity in the input to, and the regulation of, these expression and perception mechanisms. Overall, more evidence is needed, both to further elucidate these mechanisms and to inventory the patterns of cultural effects. We strongly recommend using more solid conceptual and theoretical perspectives, as well as more ecologically valid approaches, in designing future studies in emotion expression and perception research.

show abstract

“…However, this may not be the case when it comes to tonal languages. A separate body of literature has investigated the influence of the lexical tone system in tonal languages on the acoustic realization of vocal emotions (e.g., [7][8]). The motivation to examine this possible influence arose from the hypothesis that the existence of a lexical tone system may restrict the degree to which pitch can be used for other intonational variations [9].…”

Section: Introductionmentioning

confidence: 99%

An experimental study of emotional speech in Mandarin and English

Wang¹,

Lee²,

Ma³

2016

Speech Prosody 2016

View full text Add to dashboard Cite

This study reports our initial results on whether the use of pitch for expressing emotions differs between Mandarin and English. The production experiment was conducted using five emotions (anger, fear, happiness, sadness, and neutral) by comparing both prosodic cues and phonation cues between Mandarin and English emotional speech. Results demonstrated that within each language, each vocal emotion had specific acoustic patterns. Moreover, Mandarin and English showed different mechanisms of utilizing pitch for encoding emotions. The differences in pitch variation between neutral and other emotions were significantly larger in English than in Mandarin. However, the variations of speech rate and certain phonation cues (e.g., CPP and CQ) were significantly larger in Mandarin than in English. The differences in emotional speech between the two languages may be due to the restriction of pitch variation by the presence of lexical tones in Mandarin. This study reveals an interesting finding that when a certain parameter (e.g., pitch) is restricted in one language, other cues turned out to be strengthened for compensation. Therefore, we posit that the acoustic realizations of emotional speech are multidimensional.

show abstract

The effect of affect on various acoustic measures of prosody in tone and non-tone languages: A comparison based on computer analysis of voice

Cited by 74 publications

References 21 publications

How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico‐semantic cues

How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico‐semantic cues

In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion

An experimental study of emotional speech in Mandarin and English

Contact Info

Product

Resources

About