Signal-based and expectation-based factors in the perception of prosodic prominence

Cole, Jennifer; Mo, Yoonsook; Hasegawa‐Johnson, Mark

doi:10.1515/labphon.2010.022

Cited by 167 publications

(171 citation statements)

References 30 publications

Supporting

Mentioning

146

Contrasting

Order By: Relevance

“…Comparing the current findings with our prior results using RPT (e.g., Cole et al, 2010aCole et al, , 2010b, we observe similar agreement rates for boundary rating, and somewhat lower agreement for prominence rating. In that earlier study, Fleiss' kappa scores were separately calculated for four cohorts of 15-22 annotators each, with kappa scores for boundary ratings between .54-.62, and kappa scores for prominence ratings between .37-.42.…”

Section: Inter-annotator Agreement (Q1 Q2)supporting

confidence: 86%

See 1 more Smart Citation

Individual differences and patterns of convergence in prosody perception

Roy

Cole

Mahrt

2017

Laboratory Phonology: Journal of the Association for Laboratory Phonology

Self Cite

View full text Add to dashboard Cite

The challenge of prosodic annotation is reflected in commonly reported variability among trained annotators in the assignment of prosodic labels. The present study examines individual differences in the perception of prosody through the lens of prosodic annotation. First, Generalized Additive Mixed Models (GAMMs) reveal the non-linear pattern of some acoustic cues on the perception of prosodic features. Second, these same models reveal that while some of the untrained annotators are using these cues to determine prosodic features, the magnitude of effect differs quite dramatically across the annotators. Finally, the trained annotators follow the same cues as subsets of the untrained annotators, but present a much stronger effect for many of the cues. The findings show that while prosody perception is systemically related to acoustic and contextual cues, there are also individual differences that are limited to the selection and magnitude of the factors that influence prosodic rating, and the relative weighting among those factors.

show abstract

Section: Inter-annotator Agreement (Q1 Q2)supporting

confidence: 86%

“…The method of Rapid Prosodic Transcription (RPT) was used to elicit prosodic ratings (i.e., annotations) of each word (Cole et al, 2010a;Cole et al, 2010b). Transcription tasks were administered using a custom web-based presentation and annotation tool (LMEDS: Mahrt, 2016).…”

Section: Prosodic Transcription With Rapid Prosodic Transcription Andmentioning

confidence: 99%

Individual differences and patterns of convergence in prosody perception

Roy

Cole

Mahrt

2017

Laboratory Phonology: Journal of the Association for Laboratory Phonology

Self Cite

View full text Add to dashboard Cite

show abstract

“…Earlier research (Kakouros and Räsänen, 2016;Kakouros et al 2018) has proposed that unpredictable prosody may actually cause an impression of prominence (similarly to unpredictable words; see Cole et al, 2010) by triggering attentional resources in exactly the same way as surprising IDS intonation is proposed to capture infant attention in the present study. Less likely intonation was also found to alter semantic processing of the prominent words, as measured by electrophysiological recordings (Kakouros et al 2018).…”

Section: Open Questions and Concluding Remarksmentioning

confidence: 53%

“…In addition, recent work in adult speech perception suggests that low-probability intonation patterns in the context of otherwise predictable prosody are associated with higher perceptual prominence of the concurrent words (Kakouros & Räsänen, 2016). Moreover, low-probability prosodic events seem to alter the semantic processing of the speech (e.g., Magne et al, 2005;Kakouros, Salminen & Räsänen, 2018) similarly to low-probability lexical items in a predictive context (e.g., Cole, Mo & Hasegawa-Johnson, 2010). Recent preliminary findings also suggest that adult listeners are sensitive, and rapidly adapt, to changing statistical properties of the intonation patterns and this leads to experience-based expectations for prosody (Kakouros et al, 2018).…”

Section: Stimulus-driven Attention and Statistical Learningmentioning

confidence: 99%

Is infant-directed speech interesting because it is surprising? – Linking properties of IDS to statistical learning and attention at the prosodic level

Räsänen¹,

Kakouros²,

Söderström³

2017

Preprint

View full text Add to dashboard Cite

The exaggerated intonation and special rhythmic properties of infant-directed speech (IDS) have been hypothesized to attract infants' attention to the speech stream. However, there has been little work actually connecting the properties of IDS to models of attentional processing or perceptual learning. A number of such attention models suggest that surprising or novel perceptual inputs attract attention, where novelty can be operationalized as the statistical (un)predictability of the stimulus in the given context. Since prosodic patterns such as F0 contours are accessible to young infants who are also known to be adept statistical learners, the present paper investigates a hypothesis that F0 contours in IDS are less predictable than those in adult-directed speech (ADS), given previous exposure to both speaking styles, thereby potentially tapping into basic attentional mechanisms of the listeners in a similar manner that relative probabilities of other linguistic patterns are known to modulate attentional processing in infants and adults. Computational modeling analyses with naturalistic IDS and ADS speech from matched speakers and contexts show that IDS intonation has lower overall temporal predictability even when the F0 contours of both speaking styles are normalized to have equal means and variances. A closer analysis reveals that there is a tendency of IDS intonation to be less predictable at the end of short utterances, whereas ADS exhibits more stable average predictability patterns across the full extent of the utterances. The difference between IDS and ADS persists even when the proportion of IDS and ADS exposure is varied substantially, simulating different relative amounts of IDS heard in different family and cultural environments. Exposure to IDS is also found to be more efficient for predicting ADS intonation contours in new utterances than exposure to the equal amount of ADS speech. This indicates that the more variable prosodic contours of IDS also generalize to ADS, and may therefore enhance prosodic learning in infancy. Overall, the study suggests that one reason behind infant preference for IDS could be its higher information value at the prosodic level, as measured by the amount of surprisal in the F0 contours. This provides the first formal link between the properties of IDS and the models of attentional processing and statistical learning in the brain. However, this finding does not rule out the possibility that other differences between the IDS and ADS also play a role.

show abstract

“…11 [4], 4 [5], or 3 [6]. [7,8] operationalize continuous prominence annotations as binary impressions of word prominence cumulated across several listeners. For an illustration of the most popular approaches to prominence analysis, cf.…”

Section: Introductionmentioning

confidence: 99%

PromDrum: Exploiting the prosody-gesture link for intuitive, fast and fine-grained prominence annotation

Samlowski

Wagner

2016

Speech Prosody 2016

View full text Add to dashboard Cite

Most prominence annotation methods have certain drawbacks. Simple binary scales may be too coarse to capture fine-grained prominence differences, and multi-level annotation schemes have been shown to be time-consuming and difficult to use for non-expert annotators. This study proposes a novel method for fine-grained and fast prominence annotation by exploiting the prosody-gesture link. On a sentence-by-sentence basis, native German participants were instructed to listen to audio recordings and reiterate them by beating on an electronic drum pad either once per syllable (experiment 1) or once per word (experiment 2), modulating the strength of each beat according to how strongly the syllable or word stood out in the sentence. The velocity profiles of MIDI outputs were then interpreted as correlates of perceived prominence and compared with fine-grained prominence ratings by three expert annotators. While wordlevel drumming showed high correlations to conventional ratings for some of the subjects, inexperienced participants often had considerable difficulty performing the task. Syllable-level drumming, on the other hand, proved to be a time-efficient and intuitive method for experienced and naive subjects alike. Especially by pooling velocity results from several participants to create mean values, it was possible to maintain high levels of correlation with expert prominence ratings.

show abstract

Signal-based and expectation-based factors in the perception of prosodic prominence

Cited by 167 publications

References 30 publications

Individual differences and patterns of convergence in prosody perception

Individual differences and patterns of convergence in prosody perception

Is infant-directed speech interesting because it is surprising? – Linking properties of IDS to statistical learning and attention at the prosodic level

PromDrum: Exploiting the prosody-gesture link for intuitive, fast and fine-grained prominence annotation

Contact Info

Product

Resources

About