Mouth versus eyes: Gaze fixation during perception of sung interval size.

Russo, Frank A.; Sandstrom, Gillian M.; Maksimowski, Michael

doi:10.1037/h0094007

Cited by 12 publications

(14 citation statements)

References 32 publications

(41 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Participants’ ratings were also significantly correlated with the actual interval size in the V condition ( r = 0.60, p < 0.0001). Results of the V condition corroborate previous studies on judgments of visual interval size [ 10 , 21 ]. Ratings in the C condition were also significantly correlated with the actual interval size as seen and heard in the stimulus ( r = 0.889, p < 0.001).…”

Section: Resultssupporting

confidence: 88%

Audiovisual Interval Size Estimation Is Associated with Early Musical Training

Abel

Russo

et al. 2016

PLoS ONE

Self Cite

View full text Add to dashboard Cite

Although pitch is a fundamental attribute of auditory perception, substantial individual differences exist in our ability to perceive differences in pitch. Little is known about how these individual differences in the auditory modality might affect crossmodal processes such as audiovisual perception. In this study, we asked whether individual differences in pitch perception might affect audiovisual perception, as it relates to age of onset and number of years of musical training. Fifty-seven subjects made subjective ratings of interval size when given point-light displays of audio, visual, and audiovisual stimuli of sung intervals. Audiovisual stimuli were divided into congruent and incongruent (audiovisual-mismatched) stimuli. Participants’ ratings correlated strongly with interval size in audio-only, visual-only, and audiovisual-congruent conditions. In the audiovisual-incongruent condition, ratings correlated more with audio than with visual stimuli, particularly for subjects who had better pitch perception abilities and higher nonverbal IQ scores. To further investigate the effects of age of onset and length of musical training, subjects were divided into musically trained and untrained groups. Results showed that among subjects with musical training, the degree to which participants’ ratings correlated with auditory interval size during incongruent audiovisual perception was correlated with both nonverbal IQ and age of onset of musical training. After partialing out nonverbal IQ, pitch discrimination thresholds were no longer associated with incongruent audio scores, whereas age of onset of musical training remained associated with incongruent audio scores. These findings invite future research on the developmental effects of musical training, particularly those relating to the process of audiovisual perception.

show abstract

Section: Resultssupporting

confidence: 88%

Audiovisual Interval Size Estimation Is Associated with Early Musical Training

Abel

Russo

et al. 2016

PLoS ONE

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, studies completed with adults have shown that the length of attention to singers' facial cues is related to the complexity of the auditory stimuli. Russo, Sandstrom, and Maksimowski (2011) found that adults looked longer at the mouth of a singer when sung intervals were presented in combination with other auditory information than in isolation. That an increase in the amount of auditory information resulted in longer attention to the singer's facial cues may help explain infants' longer attention to singing than to speech in the present study.…”

Section: Discussionmentioning

confidence: 97%

Mode of Presentation Affects Infants’ Preferential Attention to Singing and Speech

Costa‐Giomi

2014

Music Perception

View full text Add to dashboard Cite

ALMOST FROM BIRTH, INFANTS PREFER TO ATTEND to human vocalizations associated with speech over many other sounds. However, studies that have focused on infants' differential attention to speech and singing have failed to show a speech listening bias. The purpose of the study was to investigate infants' preferential attention to singing and speech presented in audiovisual and auditory mode. Using an infant-controlled preference procedure, 11-month-olds were presented with audiovisual stimuli depicting a woman singing or reciting a song (Experiment 1, audiovisual condition). The results showed that infants attended significantly longer to singing than to speech. In Experiment 2 (visual condition), infants watched the same videos presented with no sound and in Experiment 3 (auditory condition), they listened to the singing and speech stimuli in English and a foreign language. No differences in length of attention to singing and speech were found in either experiment. The results of the study reconcile the seemingly contradicting findings of previous investigations and show that mode of presentation affects infants' preferential attention to speech and singing. The facilitating effects of facial cues on infants' processing of speech and singing are discussed.

show abstract

“…Employing a similar eye movement strategy in the dynamic face recognition task may result in similar behavioral results as the static face recognition study, with higher sensitivity in recognizing the more familiar East Asian and Western Caucasian faces than African faces (Tan et al., 2012). However, previous face-processing studies involving dynamic stimuli in naturalistic settings have revealed a different eye movement strategy, with more fixations directed toward the mouth (e.g., Pillai et al., 2012; Russo et al., 2011; Vo et al., 2012). Therefore, it is plausible that Malaysian Chinese participants’ fixation pattern may be different when viewing dynamic stimuli, as facial movements may redirect participants’ attention to features that may contain more useful visual information.…”

mentioning

confidence: 90%

“…Therefore, utilizing static stimuli may not be an accurate representation of real-life situations and, as a result, may not yield similar recognition performance as recognizing dynamic faces, which requires observers to encode information unique to a face in order to distinguish it from other faces despite possible transformation of stimuli or a change of perspective and presentation method (Hill, Schyns, & Akamatsu, 1997; Hockley, Hemsworth, & Consoli, 1999; O’Toole et al., 2006; Read, Vokey, & Hammersley, 1990; Valentin, Abdi, & Edeleman, 1999). Additionally, face-processing studies have found that observers employ different eye movement strategies, with attention directed toward the lower regions of the face, when perceiving dynamic stimuli (Pillai, Sheppard, & Mitchell, 2012; Russo, Sandstrom, & Maksimowski, 2011; Vo, Smith, Mital, & Henderson, 2012). Thus, it is plausible that observers may adopt a strategy different from those previously reported in static face recognition studies when instructed to recognize dynamic faces.…”

mentioning

confidence: 99%

Recognizing Dynamic Faces in Malaysian Chinese Participants

2015

View full text Add to dashboard Cite

High performance level in face recognition studies does not seem to be replicable in real-life situations possibly because of the artificial nature of laboratory studies. Recognizing faces in natural social situations may be a more challenging task, as it involves constant examination of dynamic facial motions that may alter facial structure vital to the recognition of unfamiliar faces. Because of the incongruences of recognition performance, the current study developed stimuli that closely represent natural social situations to yield results that more accurately reflect observers' performance in real-life settings. Naturalistic stimuli of African, East Asian, and Western Caucasian actors introducing themselves were presented to investigate Malaysian Chinese participants' recognition sensitivity and looking strategies when performing a face recognition task. When perceiving dynamic facial stimuli, participants fixated most on the nose, followed by the mouth then the eyes. Focusing on the nose may have enabled participants to gain a more holistic view of actors' facial and head movements, which proved to be beneficial in recognizing identities. Participants recognized all three races of faces equally well. The current results, which differed from a previous static face recognition study, may be a more accurate reflection of observers' recognition abilities and looking strategies.

show abstract

Mouth versus eyes: Gaze fixation during perception of sung interval size.

Cited by 12 publications

References 32 publications

Audiovisual Interval Size Estimation Is Associated with Early Musical Training

Audiovisual Interval Size Estimation Is Associated with Early Musical Training

Mode of Presentation Affects Infants’ Preferential Attention to Singing and Speech

Recognizing Dynamic Faces in Malaysian Chinese Participants

Contact Info

Product

Resources

About