Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains

Gegenfurtner, Andreas; Lehtinen, Erno; Säljö, Roger

doi:10.1007/s10648-011-9174-7

Cited by 496 publications

(527 citation statements)

References 99 publications

Supporting

Mentioning

475

Contrasting

Unclassified

Order By: Relevance

“…In the field of eye tracking there are many definitions for fixations, which may differ from Bpauses over informative regions of interest^ (Salvucci & Goldberg, 2000) to BMiniature eye movements that relatively stabilize the retina for a prolonged posture of the eyes over an object^ (Gegenfurtner, Lehtinen, & Säljö, 2011). There is not one simple definition for a fixation; some definitions are formulated as a combination of properties (duration, frequency, amount of small movements), some are functional (e.g., to help perception) or are formulated as a recipe to detect fixations.…”

Section: Labels and The Role Of Instructions And Event Selection Rulesmentioning

confidence: 99%

Is human classification by experienced untrained observers a gold standard in fixation detection?

et al. 2017

View full text Add to dashboard Cite

Manual classification is still a common method to evaluate event detection algorithms. The procedure is often as follows: Two or three human coders and the algorithm classify a significant quantity of data. In the gold standard approach, deviations from the human classifications are considered to be due to mistakes of the algorithm. However, little is known about human classification in eye tracking. To what extent do the classifications from a larger group of human coders agree? Twelve experienced but untrained human coders classified fixations in 6 min of adult and infant eye-tracking data. When using the sample-based Cohen's kappa, the classifications of the humans agreed near perfectly. However, we found substantial differences between the classifications when we examined fixation duration and number of fixations. We hypothesized that the human coders applied different (implicit) thresholds and selection rules. Indeed, when spatially close fixations were merged, most of the classification differences disappeared. On the basis of the nature of these intercoder differences, we concluded that fixation classification by experienced untrained human coders is not a gold standard. To bridge the gap between agreement measures (e.g., Cohen's kappa) and eye movement parameters (fixation duration, number of fixations), we suggest the use of the event-based F1 score and two new measures: the relative timing offset (RTO) and the relative timing deviation (RTD).

show abstract

Section: Labels and The Role Of Instructions And Event Selection Rulesmentioning

confidence: 99%

Is human classification by experienced untrained observers a gold standard in fixation detection?

et al. 2017

View full text Add to dashboard Cite

show abstract

“…In their review of eye-tracking research in various domains (such as radiology, car driving, sports, and chess), Gegenfurtner and his colleagues [31] concluded that experts (compared to less experienced professionals) have, in general, shorter fixation durations during the comprehension of visualizations. This echoes Fitts' previous conclusion about experienced pilots and their shorter fixation durations [23].…”

Section: Stage I: Pilot Training/flight Performance Analysismentioning

confidence: 99%

The Neuroergonomics of Aircraft Cockpits: The Four Stages of Eye-Tracking Integration to Enhance Flight Safety

Peysakhovich

Lefrancois

Dehais

et al. 2018

Safety

View full text Add to dashboard Cite

Abstract:Commercial aviation is currently one of the safest modes of transportation; however, human error is still one major contributing cause of aeronautical accidents and incidents. One promising avenue to further enhance flight safety is Neuroergonomics, an approach at the intersection of neuroscience, cognitive engineering and human factors, which aims to create better human-system interaction. Eye-tracking technology allows users to "monitor the monitoring" by providing insights into both pilots' attentional distribution and underlying decisional processes. In this position paper, we identify and define a framework of four stages of step-by-step integration of eye-tracking systems in modern cockpits. Stage I concerns Pilot Training and Flight Performance Analysis on-ground; stage II proposes On-board Gaze Recordings as extra data for the "black box" recorders; stage III describes Gaze-Based Flight Deck Adaptation including warning and alerting systems, and, eventually, stage IV prophesies Gaze-Based Aircraft Adaptation including authority taking by the aircraft. We illustrate the potential of these four steps with a description of incidents or accidents that we could certainly have avoided thanks to eye-tracking. Estimated milestones for the integration of each stage are also proposed together with a list of some implementation limitations. We believe that the research institutions and industrial actors of the domain will all benefit from the integration of the framework of the eye-tracking systems into cockpits.

show abstract

“…Crucially, however, it is our experience with specific scenes and objects that allows initial scene processing to be exploited, for subsequent eye movements to be guided more effectively towards task relevant areas, and for decisions to be made faster as a function of expertise (Gegenfurtner, Lehtinen, & Säljö, 2011;Reingold & Sheridan, 2011).…”

Section: Introductionmentioning

confidence: 99%

Worth a quick look? Initial scene previews can guide eye movements as a function of domain-specific expertise but can also have unforeseen costs.

Litchfield¹,

Donovan²

2016

Journal of Experimental Psychology: Human Perception and Perfor

View full text Add to dashboard Cite

Rapid scene recognition is a global visual process we can all exploit to guide search. This ability is thought to underpin expertise in medical image perception yet there is no direct evidence that isolates the expertise-specific contribution of processing scene previews on subsequent eye movement performance. We used the flash-preview moving window paradigm (Castelhano & Henderson, 2007) to investigate this issue. Expert radiologists and novice observers underwent 2 experiments whereby participants viewed a 250-ms scene preview or a mask before searching for a target. Observers looked for everyday objects from real-world scenes (Experiment 1), and searched for lung nodules from medical images (Experiment 2). Both expertise groups exploited the brief preview of the upcoming scene to more efficiently guide windowed search in Experiment 1, but there was only a weak effect of domain-specific expertise in Experiment 2, with experts showing small improvements in search metrics with scene previews. Expert diagnostic performance was better than novices in all conditions but was not contingent on seeing the scene preview, and scene preview actually impaired novice diagnostic performance. Experiment 3 required novice and experienced observers to search for a variety of abnormalities from different medical images. Rather than maximizing the expertise-specific advantage of processing scene previews, both novices and experienced radiographers were worse at detecting abnormalities with scene previews. We discuss how restricting access to the initial glimpse can be compensated for by subsequent search and discovery processing, but there can still be costs in integrating a fleeting glimpse of a medical scene.

show abstract

Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains

Cited by 496 publications

References 99 publications

Is human classification by experienced untrained observers a gold standard in fixation detection?

Is human classification by experienced untrained observers a gold standard in fixation detection?

The Neuroergonomics of Aircraft Cockpits: The Four Stages of Eye-Tracking Integration to Enhance Flight Safety

Worth a quick look? Initial scene previews can guide eye movements as a function of domain-specific expertise but can also have unforeseen costs.

Contact Info

Product

Resources

About