Model-based real-time visualization of realistic three-dimensional heat maps for mobile eye tracking and eye tracking in virtual reality

Abstract

Heat maps, or more generally, attention maps or saliency maps are an often used technique to visualize eye-tracking data. With heat maps qualitative information about visual processing can be easily visualized and communicated between experts and laymen. They are thus a versatile tool for many disciplines, in particular for usability engineering, and are often used to get a first overview about recorded eye-tracking data.Today, heat maps are typically generated for 2D stimuli that have been presented on a computer display. In such cases the mapping of overt visual attention on the stimulus is rather straight forward and the process is well understood. However, when turning towards mobile eye tracking and eye tracking in 3D virtual environments, the case is much more complicated.In the first part of the paper, we discuss several challenges that have to be considered in 3D environments, such as changing perspectives, multiple viewers, object occlusions, depth of fixations, or dynamically moving objects. In the second part, we present an approach for the generation of 3D heat maps addressing the above mentioned issues while working in real-time. Our visualizations provide high-quality output for multi-perspective eye-tracking recordings of visual attention in 3D environments.

Three-Dimensional Gaze Projection Heat-Mapping of Outdoor Mobile Eye-Tracking Data

“…Process automation within GIS and MATLAB softwares have been shown to be effective for threedimensional isovist analyses (Morello and Ratti, 2009;Yang et al, 2007). Similarly, virtual reality could offer opportunities for reducing data collection and coding workloads (Pfeiffer & Memili, 2016;Uttley et al, 2018). Such advancements would reduce the effort and time needed to generate the visualizations while lessening the potential for human error associated with their production.…”

Augmented visualization cues on primary flight display facilitating pilot's monitoring performance

“…A heatmap of visual parameters can be created from the positions of fixation points (figure 3a and 3b). The hot zones indicate where pilots focused their gaze with higher frequencies (Pfeiffer & Memili, 2016). The augmented design applied augmented visual cues (green boxes) on the PFD, it highlights the appropriate visual elements draw pilots' attention to the FMA changing modes thus increased pilot's situation awareness.…”

Performance Evaluation Strategies for Eye Gaze Estimation Systems with Quantitative Metrics and Visualizations

“…on eye tracking data. Other innovative gaze data representations can be found in [ 34 , 35 ] and a popular open source gaze data analyzer is described in [ 36 ].…”