Beyond lexical meaning: The effect of emotional prosody on spoken word recognition

Kim, Seung Kyung; Sumner, Meghan

doi:10.1121/1.4991328

Cited by 15 publications

(17 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, face showed the least interference in accuracy with the other two channels, and prosody demonstrated fewer interferences from semantics than the other way around. As predicted in Hypothesis 1, these results confirmed the communicative advantages of nonverbal signals (Beall & Herbert, 2008;Ben-David et al, 2016;Brazo et al, 2014;Filippi et al, 2017;Kim & Sumner, 2017;Kitayama & Ishii, 2002;Lin et al, 2018;Schirmer & Kotz, 2003), and replicated the Stroop effects of paralinguistic emotional cues on linguistic ones in our preceding work on multisensory integration with a larger sample size (i.e., Lin & Ding, 2019;Lin et al, 2020). While participants from a western society (e.g., Germany, the Netherlands, and the United States) tend to demonstrate a linguistic advantage in emotional speech perception (Ishii et al, 2003;Kitayama & Ishii, 2002;Kotz & Paulmann, 2007;Pell et al, 2011), our study aligns with previous studies conducted among Asian participants (e.g., Japanese and Filipinos) by revealing a reverse paralinguistic advantage among Mandarin-speaking Chinese (Ishii et al, 2003;Kitayama & Ishii, 2002).…”

Section: Perceptual Asymmetries Of Verbal and Nonverbal Cues In Emotion Cognitionsupporting

confidence: 80%

“…While a wealth of studies converge on the congruence-induced facilitation effect in emotion processing (Barnhart et al, 2018;Lin et al, 2020;McGurk & MacDonald, 1976;Pell, 2005;Schirmer et al, 2005;Schwartz & Pell, 2012), there have been mixed findings in the literature concerning the sensory dominance of communication channels. Some researchers found a processing bias toward linguistic information (Kitayama & Ishii, 2002;Pell et al, 2011), whereas others claimed the predominance of paralinguistic signals, including visual (Lin & Ding, 2019;Spence et al, 2011) and auditory prosodic (Ben-David et al, 2016;Filippi et al, 2017;Kim & Sumner, 2017;Mehrabian & Wiener, 1967;Schirmer & Kotz, 2003) cues. These findings align with studies using nonaffective stimuli (Green & Barber, 1981), suggesting that the magnitude of Stroop effects varies across verbal and nonverbal contents.…”

Section: Stroop Effects In Emotion Perceptionmentioning

confidence: 99%

See 1 more Smart Citation

Unisensory and Multisensory Stroop Effects Modulate Gender Differences in Verbal and Nonverbal Emotion Perception

Lin

Ding

Zhang

2021

J Speech Lang Hear Res

View full text Add to dashboard Cite

Purpose This study aimed to examine the Stroop effects of verbal and nonverbal cues and their relative impacts on gender differences in unisensory and multisensory emotion perception. Method Experiment 1 investigated how well 88 normal Chinese adults (43 women and 45 men) could identify emotions conveyed through face, prosody and semantics as three independent channels. Experiments 2 and 3 further explored gender differences during multisensory integration of emotion through a cross-channel (prosody-semantics) and a cross-modal (face-prosody-semantics) Stroop task, respectively, in which 78 participants (41 women and 37 men) were asked to selectively attend to one of the two or three communication channels. Results The integration of accuracy and reaction time data indicated that paralinguistic cues (i.e., face and prosody) of emotions were consistently more salient than linguistic ones (i.e., semantics) throughout the study. Additionally, women demonstrated advantages in processing all three types of emotional signals in the unisensory task, but only preserved their strengths in paralinguistic processing and showed greater Stroop effects of nonverbal cues on verbal ones during multisensory perception. Conclusions These findings demonstrate clear gender differences in verbal and nonverbal emotion perception that are modulated by sensory channels, which have important theoretical and practical implications. Supplemental Material https://doi.org/10.23641/asha.16435599

show abstract

Section: Perceptual Asymmetries Of Verbal and Nonverbal Cues In Emotion Cognitionsupporting

confidence: 80%

Section: Stroop Effects In Emotion Perceptionmentioning

confidence: 99%

Unisensory and Multisensory Stroop Effects Modulate Gender Differences in Verbal and Nonverbal Emotion Perception

Lin

Ding

Zhang

2021

J Speech Lang Hear Res

View full text Add to dashboard Cite

show abstract

“…This has also to be considered in the interpretation of the present findings. However, several studies presenting spoken prime words used comparable timing as in the present study and reported priming effects (Holcomb and Neville ( 1990 ) SOA = 1,420–1,850 ms, ISI = 1,150 ms; Voyer and Myles ( 2017 ) SOA = 800–1,000 ms, ISI = 50–250 ms; Kim and Sumner ( 2017 ) SOA = not indicated, ISI = 100 ms; Bacovcin et al ( 2017 ) SOA = not indicated, ISI = 400–600 ms). Holcomb and Neville ( 1990 ) even reported stronger priming effects for auditory (SOA 1,420–1,850 ms) than visual prime words (SOA 1,550 ms), which had even longer SOA.…”

Section: Discussionmentioning

confidence: 55%

Relation Between Mathematical Performance, Math Anxiety, and Affective Priming in Children With and Without Developmental Dyscalculia

et al. 2018

View full text Add to dashboard Cite

Many children show negative emotions related to mathematics and some even develop mathematics anxiety. The present study focused on the relation between negative emotions and arithmetical performance in children with and without developmental dyscalculia (DD) using an affective priming task. Previous findings suggested that arithmetic performance is influenced if an affective prime precedes the presentation of an arithmetic problem. In children with DD specifically, responses to arithmetic operations are supposed to be facilitated by both negative and mathematics-related primes (=negative math priming effect).We investigated mathematical performance, math anxiety, and the domain-general abilities of 172 primary school children (76 with DD and 96 controls). All participants also underwent an affective priming task which consisted of the decision whether a simple arithmetic operation (addition or subtraction) that was preceded by a prime (positive/negative/neutral or mathematics-related) was true or false. Our findings did not reveal a negative math priming effect in children with DD. Furthermore, when considering accuracy levels, gender, or math anxiety, the negative math priming effect could not be replicated. However, children with DD showed more math anxiety when explicitly assessed by a specific math anxiety interview and showed lower mathematical performance compared to controls. Moreover, math anxiety was equally present in boys and girls, even in the earliest stages of schooling, and interfered negatively with performance. In conclusion, mathematics is often associated with negative emotions that can be manifested in specific math anxiety, particularly in children with DD. Importantly, present findings suggest that in the assessed age group, it is more reliable to judge math anxiety and investigate its effects on mathematical performance explicitly by adequate questionnaires than by an affective math priming task.

show abstract

“…Because natural speech is inherently a dynamic stimulus, following one specific talker among competing talkers involves using the patterns of variation of the target talker's voice to anticipate that talker's speech. Prosodic information, which involves the plausible variation in vocal pitch, intensity, and timing, may be particularly useful in that regard (e.g., Calandruccio et al, 2019 ; Kim & Sumner, 2017 ; Zekveld et al, 2014 ). Of the cues that comprise prosody, variation in level has received less attention as a potential cue in CPP communication situations than other factors, such as pitch and intonation.…”

Section: Introductionmentioning

confidence: 99%

The Effects of Uncertainty in Level on Speech-on-Speech Masking

2022

View full text Add to dashboard Cite

Identification of speech from a "target" talker was measured in a speech-on-speech masking task with two simultaneous "masker" talkers. The overall level of each talker was either fixed or randomized throughout each stimulus presentation to investigate the effectiveness of level as a cue for segregating competing talkers and attending to the target. Experimental manipulations included varying the level difference between talkers and imposing three types of target level uncertainty: 1) fixed target level across trials, 2) random target level across trials, or 3) random target levels on a word-by-word basis within a trial. When the target level was predictable performance was better than corresponding conditions when the target level was uncertain. Masker confusions were consistent with a high degree of informational masking (IM). Furthermore, evidence was found for "tuning" in level and a level "release" from IM. These findings suggest that conforming to listener expectation about relative level, in addition to cues signaling talker identity, facilitates segregation of, and maintaining focus of attention on, a specific talker in multiple-talker communication situations.

show abstract

Beyond lexical meaning: The effect of emotional prosody on spoken word recognition

Cited by 15 publications

References 17 publications

Unisensory and Multisensory Stroop Effects Modulate Gender Differences in Verbal and Nonverbal Emotion Perception

Unisensory and Multisensory Stroop Effects Modulate Gender Differences in Verbal and Nonverbal Emotion Perception

Relation Between Mathematical Performance, Math Anxiety, and Affective Priming in Children With and Without Developmental Dyscalculia

The Effects of Uncertainty in Level on Speech-on-Speech Masking

Contact Info

Product

Resources

About