Seeing a singer helps comprehension of the song’s lyrics

Jesse, Alexandra; Massaro, Dominic W.

doi:10.3758/pbr.17.3.323

Cited by 20 publications

(14 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When asked to identify lyrics, participants were correct 28% of the time in the auditory condition and 33% in the audio-visual condition. This increase in intelligibility is modest in comparison with that typically observed for spoken stimuli (but see Jesse & Massaro, 2010).…”

Section: Stimulimentioning

confidence: 77%

A comparison of the McGurk effect for spoken and sung syllables

Quinto

Thompson

Russo

et al. 2010

Attention, Perception, & Psychophysics

View full text Add to dashboard Cite

show abstract

Section: Stimulimentioning

confidence: 77%

A comparison of the McGurk effect for spoken and sung syllables

Quinto

Thompson

Russo

et al. 2010

Attention, Perception, & Psychophysics

View full text Add to dashboard Cite

show abstract

“…Visual information also aids in the understanding of speech embedded in music. For example, it is easier to understand song lyrics when watching the singers than when just listening to them (Hidalgo-Barnes & Massaro, 2007;Jesse & Massaro, 2010). Additionally, the visual information displayed by a singer affects the perception of music parameters such as the size of the intervals sung (Thompson & Russo, 2007;Thompson, Russo, & Livingstone, 2010).…”

Section: Nfants Are Immersed In Sound Even Beforementioning

confidence: 95%

Mode of Presentation Affects Infants’ Preferential Attention to Singing and Speech

Costa‐Giomi

2014

Music Perception

View full text Add to dashboard Cite

ALMOST FROM BIRTH, INFANTS PREFER TO ATTEND to human vocalizations associated with speech over many other sounds. However, studies that have focused on infants' differential attention to speech and singing have failed to show a speech listening bias. The purpose of the study was to investigate infants' preferential attention to singing and speech presented in audiovisual and auditory mode. Using an infant-controlled preference procedure, 11-month-olds were presented with audiovisual stimuli depicting a woman singing or reciting a song (Experiment 1, audiovisual condition). The results showed that infants attended significantly longer to singing than to speech. In Experiment 2 (visual condition), infants watched the same videos presented with no sound and in Experiment 3 (auditory condition), they listened to the singing and speech stimuli in English and a foreign language. No differences in length of attention to singing and speech were found in either experiment. The results of the study reconcile the seemingly contradicting findings of previous investigations and show that mode of presentation affects infants' preferential attention to speech and singing. The facilitating effects of facial cues on infants' processing of speech and singing are discussed.

show abstract

“…The role of facial expression in music performance has been given greatest attention among singers, where studies have found their expressions to aid in lyric comprehension (Jesse and Massaro, 2010), to alter pitch perception (Thompson et al, 2005, 2010), to indicate musical phrasing (Ceaser et al, 2009) and to enhance emotional expression (Thompson et al, 2008; Quinto et al, 2014; Livingstone et al, 2015). However, facial expression has been experimentally examined far less in instrumentalists.…”

Section: Introductionmentioning

confidence: 99%

Eye of the Beholder: Stage Entrance Behavior and Facial Expression Affect Continuous Quality Ratings in Music Performance

Waddell

Williamon

2017

Front. Psychol.

View full text Add to dashboard Cite

Judgments of music performance quality are commonly employed in music practice, education, and research. However, previous studies have demonstrated the limited reliability of such judgments, and there is now evidence that extraneous visual, social, and other “non-musical” features can unduly influence them. The present study employed continuous measurement techniques to examine how the process of forming a music quality judgment is affected by the manipulation of temporally specific visual cues. Video footage comprising an appropriate stage entrance and error-free performance served as the standard condition (Video 1). This footage was manipulated to provide four additional conditions, each identical save for a single variation: an inappropriate stage entrance (Video 2); the presence of an aural performance error midway through the piece (Video 3); the same error accompanied by a negative facial reaction by the performer (Video 4); the facial reaction with no corresponding aural error (Video 5). The participants were 53 musicians and 52 non-musicians (N = 105) who individually assessed the performance quality of one of the five randomly assigned videos via a digital continuous measurement interface and headphones. The results showed that participants viewing the “inappropriate” stage entrance made judgments significantly more quickly than those viewing the “appropriate” entrance, and while the poor entrance caused significantly lower initial scores among those with musical training, the effect did not persist long into the performance. The aural error caused an immediate drop in quality judgments that persisted to a lower final score only when accompanied by the frustrated facial expression from the pianist; the performance error alone caused a temporary drop only in the musicians' ratings, and the negative facial reaction alone caused no reaction regardless of participants' musical experience. These findings demonstrate the importance of visual information in forming evaluative and aesthetic judgments in musical contexts and highlight how visual cues dynamically influence those judgments over time.

show abstract

Seeing a singer helps comprehension of the song’s lyrics

Cited by 20 publications

References 33 publications

A comparison of the McGurk effect for spoken and sung syllables

A comparison of the McGurk effect for spoken and sung syllables

Mode of Presentation Affects Infants’ Preferential Attention to Singing and Speech

Eye of the Beholder: Stage Entrance Behavior and Facial Expression Affect Continuous Quality Ratings in Music Performance

Contact Info

Product

Resources

About