Spatial statistics of gaze fixations during dynamic face processing

Buchan, Julie N.; Paré, Martin; Munhall, Kevin G.

doi:10.1080/17470910601043644

Cited by 126 publications

(173 citation statements)

References 44 publications

Supporting

Mentioning

162

Contrasting

Order By: Relevance

“…This pattern is confirmed in our finding that the eyes were indeed looked at most frequently. When auditory noise is added to the speech, or when the task requires accurate auditory discriminations, a higher frequency of fixations are made to the mouth (Buchan, Pare, & Munhall, 2007). Intriguingly, deaf people also tend to look at the eyes of others communicating with sign language, although beginners also look at the mouth (Emmorey, Thompson, & Colvin, 2009).…”

Section: Discussionmentioning

confidence: 99%

Gaze allocation in a dynamic situation: Effects of social status and speaking

et al. 2010

View full text Add to dashboard Cite

a b s t r a c tHuman visual attention operates in a context that is complex, social and dynamic. To explore this, we recorded people taking part in a group decision-making task and then showed video clips of these situations to new participants while tracking their eye movements. Observers spent the majority of time looking at the people in the videos, and in particular at their eyes and faces. The social status of the people in the clips had been rated by their peers in the group task, and this status hierarchy strongly predicted where eyetracker participants looked: high-status individuals were gazed at much more often, and for longer, than low-status individuals, even over short, 20-s videos. Fixation was temporally coupled to the person who was talking at any one time, but this did not account for the effect of social status on attention. These results are consistent with a gaze system that is attuned to the presence of other individuals, to their social status within a group, and to the information most useful for social interaction.

show abstract

Section: Discussionmentioning

confidence: 99%

Gaze allocation in a dynamic situation: Effects of social status and speaking

et al. 2010

View full text Add to dashboard Cite

show abstract

“…These studies, however, often use a free-viewing task, which lacks a specific task context, to test non-pet-owners. Given that our gaze allocation in face exploration is subject to a modulatory role of task-based top-down guidance (Buchan, Pare, & Munhall, 2000;Malcolm, Lanyon, Fugard, & Barton, 2008), it remains unclear whether our enhanced experience with non-conspecific faces (e.g., pet owners) would influence our gaze allocation for extracting salient facial cues and/or facilitate the subsequent processing of specific facial information.…”

Section: Introductionmentioning

confidence: 99%

Dog owners show experience-based viewing behaviour in judging dog face approachability

Gavin

Houghton

Guo

2015

Psychological Research

View full text Add to dashboard Cite

Our prior visual experience plays a critical role in face perception. We show superior perceptual performance for differentiating conspecific (vs non-conspecific), own-race (vs other-race) and familiar (vs unfamiliar) faces. However, it remains unclear whether our experience with faces of other species would influence our gaze allocation for extracting salient facial information. In this eye-tracking study, we asked both dogowners and non-owners to judge the approachability of human, monkey and dog faces, and systematically compared their behavioral performance and gaze pattern associated with the task. Compared to non-owners, dog-owners assessed dog faces with shorter time and fewer fixations, but gave higher approachability ratings. The gaze allocation within local facial features was also modulated by the ownership. The averaged proportion of the fixations and viewing time directed at the dog mouth region were significantly less for the dog-owners, and more experienced dog-owners tended to look more at the dog eyes, suggesting the adoption of a prior experience-based viewing behavior for assessing dog approachability. No differences in behavioral performance and gaze pattern were observed between dog-owners and non-owners when judging human and monkey faces, implying the dog-owner's experience-based gaze strategy for viewing dog faces was not transferable across faces of other species.

show abstract

“…To date, the active visual exploration of dynamic faces has only been investigated during audiovisual and visual-only speech perception (e.g. Vatikiotis-Bateson et al, 1998;Lansing & McConkie, 1999, 2003Paré et al, 2003;Buchan et al, 2007;Everdell et al, 2007) and so it is still unknown how an explicit identity task using dynamic facial stimuli might influence gaze behavior.A second, related possibility for the difference in mouth fixations is that the identity of a talking face is not restricted to the visual modality. Voices also contain information about identity and gaze fixations may be tuned to maximize the audiovisual integration of this information.…”

mentioning

confidence: 99%

“…The knowledge driven nature of gaze fixations is also evident in the gaze behaviors exhibited while watching talking faces. Gaze behavior studies examining audiovisual (Buchan, Paré & visual-only (Lansing &McConkie, 1999) speech have shown that task instructions influence facial locations from which information is gathered.The influence of task instructions on gaze behavior, however, is surprisingly modest (Buchan, Paré & Munhall, 2007;Lansing & McConkie, 1999). While task instructions cause a slight shift in the preferred fixation locations on the face, the overall spatial distribution of fixations nonetheless remains fairly similar across tasks.…”

mentioning

confidence: 99%

“…In a study using extended monologues, Vatikiotis-Bateson et al (1998) this is nonetheless consistent with the substantially increased median fixation durations on both the nose and mouth found in the current study. Buchan et al (2007) used emotionally expressive talking faces and also saw an increase in median fixation duration on the nose and mouth when noise was added.The increase in gaze fixations on the central part of the face is consistent with the fact that direct foveation of the mouth is not required in order to gather visual speech information (Paré et al, 2003). Rather crude video of the face, which has been degraded by either pixilation (MacDonald, Andersen & Bachmann, 2000) or by spatial frequency filtering (Munhall, Kroos, Jozan & Vatikiotis-Bateson, 2004), provides sufficient visual speech information to influence the perception of speech.…”

mentioning

confidence: 99%

See 1 more Smart Citation

The effect of varying talker identity and listening conditions on gaze behavior during audiovisual speech perception

2008

Self Cite

View full text Add to dashboard Cite

During face-to-face conversation the face provides auditory and visual linguistic information, and also conveys information about the identity of the speaker. This study investigated behavioral strategies involved in gathering visual information while watching talking faces. The effects of varying talker identity and varying the intelligibility of speech (by adding acoustic noise) on gaze behavior were measured with an eyetracker. Varying the intelligibility of the speech by adding noise had a noticeable effect on the location and duration of fixations. When noise was present subjects adopted a vantage point that was more centralized on the face by reducing the frequency of the fixations on the eyes and mouth and lengthening the duration of their gaze fixations on the nose and mouth. Varying talker identity resulted in a more modest change in gaze behavior that was modulated by the intelligibility of the speech. Although subjects generally used similar strategies to extract visual information in both talker variability conditions, when noise was absent there were more fixations on the mouth when viewing a different talker every trial as opposed to the same talker every trial. These findings provide a useful baseline for studies examining gaze behavior during audiovisual speech perception and perception of dynamic faces. IntroductionWe see and process faces every day in a wide variety of contexts, from line drawings of faces and static photographs, to dynamic movies and live faces during face-to-face communication. These faces contain a wealth of social, emotional, identity and linguistic information. Although a great deal of information can be gleaned from static faces, the motion of dynamic faces contains information about identity and emotion not present in static faces (Ambadar, Schooler & Cohn, 2005;Hill & Johnson, 2001;Knappmeyer, Thornton & Bülthoff, 2003;O'Toole, Roark, & Abdi, 2002;Lander & Bruce, 2000). Facial motion also contains linguistic information, as evidenced by the fact that silent speechreading is possible (Bernstein, Demorest & Tucker, 2000). Rarely though, is this visual speech information present in the complete absence of auditory speech information and audiovisual speech perception is the natural manner of communication. Visual speech information influences the perception of auditory speech in both perfectly audible conditions (McGurk & MacDonald, 1976, MacDonald & Correspondence: J.N. Buchan, Department of Psychology, Queen's University, Humphrey Hall, 62 Arch Street, Kingston, Ontario, Canada K7L 3N6, Tel: 613-533-6275, E-mail: 2jnb@queensu.ca. Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and al...

show abstract

Spatial statistics of gaze fixations during dynamic face processing

Cited by 126 publications

References 44 publications

Gaze allocation in a dynamic situation: Effects of social status and speaking

Gaze allocation in a dynamic situation: Effects of social status and speaking

Dog owners show experience-based viewing behaviour in judging dog face approachability

The effect of varying talker identity and listening conditions on gaze behavior during audiovisual speech perception

Contact Info

Product

Resources

About