Guiding the mind's eye: improving communication and vision by external control of the scanpath

Barth, Erhardt; Dörr, Michael; Böhme, Martin; Gegenfurtner, Karl R.; Martinetz, Thomas

doi:10.1117/12.674147

Cited by 24 publications

(17 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Besides general eye movement parameters such as saccadic amplitude, fixation duration, and the central bias, we also analyze gaze variability, i.e., the similarity between eye movements of different observers. This was motivated by our work on gaze guidance to aid observers in following optimal gaze patterns (Barth, Dorr, Böhme, Gegenfurtner, & Martinetz, 2006). More specifically, we aimed to understand the limits of variability in eye movements observers make on dynamic natural scenes.…”

Section: Purpose Of This Studymentioning

confidence: 99%

Variability of eye movements when viewing dynamic natural scenes

et al. 2010

View full text Add to dashboard Cite

How similar are the eye movement patterns of different subjects when free viewing dynamic natural scenes? We collected a large database of eye movements from 54 subjects on 18 high-resolution videos of outdoor scenes and measured their variability using the Normalized Scanpath Saliency, which we extended to the temporal domain. Even though up to about 80% of subjects looked at the same image region in some video parts, variability usually was much greater. Eye movements on natural movies were then compared with eye movements in several control conditions. "Stop-motion" movies had almost identical semantic content as the original videos but lacked continuous motion. Hollywood action movie trailers were used to probe the upper limit of eye movement coherence that can be achieved by deliberate camera work, scene cuts, etc. In a "repetitive" condition, subjects viewed the same movies ten times each over the course of 2 days. Results show several systematic differences between conditions both for general eye movement parameters such as saccade amplitude and fixation duration and for eye movement variability. Most importantly, eye movements on static images are initially driven by stimulus onset effects and later, more so than on continuous videos, by subject-specific idiosyncrasies; eye movements on Hollywood movies are significantly more coherent than those on natural movies. We conclude that the stimuli types often used in laboratory experiments, static images and professionally cut material, are not very representative of natural viewing behavior. All stimuli and gaze data are publicly available at http://www.inb.uni-luebeck.de/tools-demos/gaze.

show abstract

Section: Purpose Of This Studymentioning

confidence: 99%

Variability of eye movements when viewing dynamic natural scenes

et al. 2010

View full text Add to dashboard Cite

show abstract

“…9 The goal is to augment human vision with computer vision technology in a least-obtrusive way. Gaze guidance is realized by gaze-contingent interactive displays that use an eye tracker to monitor the viewer's gaze.…”

Section: Introductionmentioning

confidence: 99%

Learned saliency transformations for gaze guidance

2011

Self Cite

View full text Add to dashboard Cite

The saliency of an image or video region indicates how likely it is that the viewer of the image or video fixates that region due to its conspicuity. An intriguing question is how we can change the video region to make it more or less salient. Here, we address this problem by using a machine learning framework to learn from a large set of eye movements collected on real-world dynamic scenes how to alter the saliency level of the video locally. We derive saliency transformation rules by performing spatio-temporal contrast manipulations (on a spatio-temporal Laplacian pyramid) on the particular video region. Our goal is to improve visual communication by designing gaze-contingent interactive displays that change, in real time, the saliency distribution of the scene.

show abstract

“…Eye tracking may change the way people interact with technology and the way visual information is communicated. Current work on gaze guidance [2] has the goal of augmenting a video or visual display with a recommendation of how to view the information, of what is to be seen. The advances currently being made in eye tracking hardware and software may finally help make widespread low-cost eye tracking a reality.…”

Section: Discussionmentioning

confidence: 99%

A geometric approach to remote eye tracking

Villanueva

Daunys

Hansen

et al. 2009

Univ Access Inf Soc

Self Cite

View full text Add to dashboard Cite

This paper presents a principled analysis of various combinations of image features to determine their suitability for remote eye tracking. It begins by reviewing the basic theory underlying the connection between eye image and gaze direction. Then a set of approaches is proposed based on different combinations of well-known features and their behaviour is evaluated, taking into account various additional criteria such as free head movement, and minimum hardware and calibration requirements. The paper proposes a final method based on multiple glints and the pupil centre; the method is evaluated experimentally. Future trends in eye tracking technology are also discussed.

show abstract

Guiding the mind's eye: improving communication and vision by external control of the scanpath

Cited by 24 publications

References 16 publications

Variability of eye movements when viewing dynamic natural scenes

Variability of eye movements when viewing dynamic natural scenes

Learned saliency transformations for gaze guidance

A geometric approach to remote eye tracking

Contact Info

Product

Resources

About