When emotional prosody and semantics dance cheek to cheek: ERP evidence

Kotz, Sonja A.; Paulmann, Silke

doi:10.1016/j.brainres.2007.03.015

Cited by 143 publications

(153 citation statements)

References 41 publications

Supporting

Mentioning

128

Contrasting

Order By: Relevance

“…Paulmann & Kotz, 2008a;Schirmer & Kotz, 2006), even when this information is not task relevant (Kotz & Paulmann, 2007). These data confirm that prosodic cues ing to both the prime and the target stimuli get automatically activated, since emotionally unrelated targets are processed differently from emotionally related targets in both the 200-and 400-msec prime duration conditions.…”

Section: Discussionsupporting

confidence: 67%

“…According to this perspective, short primes are specifically ignored by participants, and, because they are less activated (i.e., ignored), such primes (and N400-like negativities, such as the N300) reflects the processing of broken emotional context expectations (Bostanov & Kotchoubey, 2004;Kotz & Paulmann, 2007;Paulmann & Kotz, 2008b;Paulmann, Pell, & Kotz, 2008;Schirmer et al, 2002;Zhang et al, 2006). Our data confirm that this emotional context violation response can be elicited by very briefly presented (200-msec) prosodic stimuli, although longer (400-msec) prime durations lead to different effect directions in the N400 (see the Discussion).…”

Section: Reversed Emotional Priming Effectsmentioning

confidence: 99%

See 1 more Smart Citation

Contextual influences of emotional speech prosody on face processing: How much is enough?

Paulmann

Pell

2010

Cognitive, Affective, & Behavioral Neuroscience

Self Cite

View full text Add to dashboard Cite

230Efforts to understand how the brain processes emotional information have increased rapidly over the last years. New studies are shedding light on the complex and diverse nature of these processes and on the speed with which emotional information is assimilated to ensure effective social behavior. The emotional significance of incoming events needs to be evaluated within milliseconds, followed by more conceptual-based knowledge processing, which often regulates emotionally appropriate behaviors (cf. Phillips, Drevets, Rauch, & Lane, 2003). In everyday situations, emotional stimuli are not often processed in isolation; rather, we are confronted with a stream of incoming information or events from different sources. To advance knowledge of how our brain successfully processes emotions from different information sources and how these sources influence each other, we investigated how and when emotional tone of voice influences the processing of an emotional face, a situation that occurs routinely in face-to-face social interactions. Effects of Emotional ContextThe importance of context in emotion perception has been emphasized by several researchers (e.g., de Gelder et al., 2006;Feldmann Barett, Lindquist, & Gendron, 2007;Russell & Fehr, 1987). Context may be defined as the situation or circumstances that precede and/or accompany certain events, and both verbal contexts (created by language use) and social contexts (created by situations, scenes, etc.) have been shown to influence emotion perception. For example, depending on how the sentence, "Your parents are here? I can't wait to see them," is intoned, the speaker may be interpreted either as being pleasantly surprised by the unforeseen event or as feeling the very opposite. Here, emotional prosody-that is, the acoustic variations of perceived pitch, intensity, speech rate, and voice quality-serves as a context for interpreting the verbal message. Emotional prosody can influence not only the interpretation of a verbal message but also the early perception of facial expressions Massaro & Egan, 1996;Pourtois, de Gelder, Vroomen, Rossion, & Crommelinck, 2000). The latter reports have led to the proposal that emotional information in the prosody and face channels is automatically evaluated and integrated early during the processing of these events (de Gelder et al., 2006 The influence of emotional prosody on the evaluation of emotional facial expressions was investigated in an event-related brain potential (ERP) study using a priming paradigm, the facial affective decision task. Emotional prosodic fragments of short (200-msec) and medium (400-msec) duration were presented as primes, followed by an emotionally related or unrelated facial expression (or facial grimace, which does not resemble an emotion). Participants judged whether or not the facial expression represented an emotion. ERP results revealed an N400-like differentiation for emotionally related prime-target pairs when compared with unrelated prime-target pairs. Faces preceded by prosodic primes of mediu...

show abstract

Section: Discussionsupporting

confidence: 67%

Section: Reversed Emotional Priming Effectsmentioning

confidence: 99%

Contextual influences of emotional speech prosody on face processing: How much is enough?

Paulmann

Pell

2010

Cognitive, Affective, & Behavioral Neuroscience

Self Cite

View full text Add to dashboard Cite

show abstract

“…the P200 component, known to detect emotional salience) is intact (Paulmann et al, 2011). Recent evidence from healthy individuals, where bilateral fronto-striatal activation was found during emotional categorisation tasks on spoken language (especially after elimination of the language's semantic content) (Kotz et al, 2003;Kotz and Paulmann, 2007), further indicates that the basal ganglia play a major function in the processing of affective communication.…”

Section: Basal Gangliamentioning

confidence: 99%

Subcortical processing in auditory communication

2015

View full text Add to dashboard Cite

a b s t r a c tThe voice is a rich source of information, which the human brain has evolved to decode and interpret. Empirical observations have shown that the human auditory system is especially sensitive to the human voice, and that activity within the voice-sensitive regions of the primary and secondary auditory cortex is modulated by the emotional quality of the vocal signal, and may therefore subserve, with frontal regions, the cognitive ability to correctly identify the speaker's affective state. So far, the network involved in the processing of vocal affect has been mainly characterised at the cortical level. However, anatomical and functional evidence suggests that acoustic information relevant to the affective quality of the auditory signal might be processed prior to the auditory cortex.Here we review the animal and human literature on the main subcortical structures along the auditory pathway, and propose a model whereby the distinction between different types of vocal affect in auditory communication begins at very early stages of auditory processing, and relies on the analysis of individual acoustic features of the sound signal. We further suggest that this early feature-based decoding occurs at a subcortical level along the ascending auditory pathway, and provides a preliminary coarse (but fast) characterisation of the affective quality of the auditory signal before the more refined (but slower) cortical processing is completed.

show abstract

“…Using a crosssplicing technique, a leading phrase of a sentence was crossspliced with the main stem of a sentence either congruent or incongruent in prosody with the leading phrase. The onset of the crosssplicing point of the vocal expression in the main sentence elicited a larger negativity (350-550 ms) for a mismatch in both voice and lexico-semantics and a larger more right-hemispheric distributed positivity (600-950 ms) for a mismatch in voice only (pseudouterances: [3]; uterances with no emotional lexical items: [1]). The negativity suggested an efort of integrating the emotional information in both vocal and semantic channel with the context.…”

Section: Neurophysiological Studies On Basic Vocal Emotion In Speechmentioning

confidence: 97%

“…), which roughly correspond to each hypothesized processing stage [1,2]. Studies with event-related potentials (ERPs), which focused on the analysis of averaged electrophysiological response to a certain vocal or speech event, have enlightened neurocognitive processes at a ine-grained temporal scale.…”

Section: Introductionmentioning

confidence: 99%

Tracking the Sound of Human Affection: EEG Signals Reveal Online Decoding of Socio-Emotional Expression in Human Speech and Voice

Jiang¹

2017

Emotion and Attention Recognition Based on Biological Signals and Images

View full text Add to dashboard Cite

This chapter provides a perspective from the latest EEG evidence in how brain signals enlighten the neurophysiological and neurocognitive mechanisms underlying the recognition of socioemotional expression conveyed in human speech and voice, drawing upon event-related potentials' studies (ERPs). Human sound can encode emotional meanings by diferent vocal parameters in words, real-vs. pseudo-speeches, and vocalizations. Based on the ERP indings, recent development of the three-stage model in vocal processing has highlighted initial-and late-stage processing of vocal emotional stimuli. These processes, depending on which ERP components they were mapped onto, can be divided into the acoustic analysis, relevance and motivational processing, ine-grained meaning analysis/integration/access, and higher-level social inference, as the unfolding of the time scale. ERP studies on vocal socioemotions, such as happiness, anger, fear, sadness, neutral, sincerity, conidence, and sarcasm in the human voice and speech have employed diferent experimental paradigms such as crosssplicing, crossmodality priming, oddball, stroop, etc. Moreover, task demand and listener characteristics afect the neural responses underlying the decoding processes, revealing the role of atention deployment and interpersonal sensitivity in the neural decoding of vocal emotional stimuli. Cultural orientation afects our ability to decode emotional meaning in the voice. Neurophysiological paterns were compared between normal and abnormal emotional processing in the vocal expressions, especially in schizophrenia and in congenital amusia. Future directions highlight the study on human vocal expression aligning with other nonverbal cues, such as facial and body language, and the need to synchronize listener's brain potentials with other peripheral measures.

show abstract

When emotional prosody and semantics dance cheek to cheek: ERP evidence

Cited by 143 publications

References 41 publications

Contextual influences of emotional speech prosody on face processing: How much is enough?

Contextual influences of emotional speech prosody on face processing: How much is enough?

Subcortical processing in auditory communication

Tracking the Sound of Human Affection: EEG Signals Reveal Online Decoding of Socio-Emotional Expression in Human Speech and Voice

Contact Info

Product

Resources

About