Objects guide human gaze behavior in dynamic real-world scenes

Abstract

The complexity of natural scenes makes it challenging to experimentally study the mechanisms behind human gaze behavior when viewing dynamic environments. Historically, eye movements were believed to be driven primarily by bottom-up saliency, but increasing evidence suggests that objects also play a significant role in guiding attention. We present a new computational framework to investigate the importance of objects for attentional guidance. This framework is designed to simulate realistic scanpaths for dynamic real-world scenes, including saccade timing and smooth pursuit behavior. Individual model components are based on psychophysically uncovered mechanisms of visual attention and saccadic decision-making. All mechanisms are implemented in a modular fashion with a small number of well-interpretable parameters. To systematically analyze the importance of objects in guiding gaze behavior, we implemented four different models within this framework: two purely location-based models, where one is based on low-level saliency and one on high-level saliency, and two object-based models, with one incorporating low-level saliency for each object and the other one not using any saliency information. We optimized each model's parameters to reproduce the saccade amplitude and fixation duration distributions of human scanpaths using evolutionary algorithms. We compared model performance with respect to spatial and temporal fixation behavior, including the proportion of fixations exploring the background, as well as detecting, inspecting, and revisiting objects. A model with object-based attention and inhibition, which uses saliency information to prioritize between objects for saccadic selection, leads to scanpath statistics with the highest similarity to the human data. This demonstrates that scanpath models benefit from object-based attention and selection, suggesting that object-level attentional units play an important role in guiding attentional processing.

Pain and Fear in the Eyes: Gaze Dynamics Predicts Social Anxiety from Fear Generalisation

“…As to the analyses, a number of works have recently considered eye movements modelling from the foraging perspective (e.g., [23,8,7,22,20,9]) or the closely related one that exploits sequential decision-making based on drift-diffusion models (e.g. [10,31]). With respect to the analyses needed here such models are overly complex, given their aim of actually simulating gaze shifts, and/or just suitable to cope with simple visual stimuli.…”