2D and 3D Visualization of Eye Gaze Patterns in a VR-Based Job Interview Simulator: Application in Educating Employers on the Gaze Patterns of Autistic Candidates

Breen, Michael S.; McClarty, James; Langley, Caleb; Farzidayeri, Jamshid; Trevethan, Kyle; Swenson, Brandon; Sarkar, Medha Shukla; Wade, Joshua; Sarkar, Nilanjan

doi:10.1007/978-3-030-78092-0_36

Cited by 4 publications

(5 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Shi et al ( 2020 ) visualize the gaze point in red in the 3D scene, but they provide no further specific details on its shape in the text. Breen et al ( 2021 ) use four different point-based visualizations. One technique is a playback of a single green 3D sphere representing the 3D gaze data (raycasting of gaze ray to the VE geometry) moving over time.…”

Section: Resultsmentioning

confidence: 99%

“…If the user wants to see the current gaze point at the same time as the complete set, it is shown in a contrasting color to the rest. Breen et al ( 2021 ) also use the scanpath terminology, but even though it is possible to explore the gaze order in real-time, the points have no connecting lines between them like in traditional scanpath visualizations for 2D. Ugwitz et al ( 2022 ) visualize gaze movement with a small white sphere object at the fixation point.…”

Section: Resultsmentioning

confidence: 99%

“…Bianconi et al ( 2019 ) also reported the benefits of 3D by being able to use immersive 3D gaze analysis to explore the impact of various design choices, resulting in reduced virtual complexity. However, Breen et al ( 2021 ) also point out that it can be useful to have both non-immersive 2D and VR for users that are not as comfortable with 3D. Singh et al ( 2018 ) mention that there is a gap in what one can do in 2D and outdoor physical, real-world environments.…”

Section: Discussionmentioning

confidence: 99%

“…Shi et al ( 2020 ) also propose personalized information systems adjusted to the user. Breen et al ( 2021 ) propose to integrate 3D visualization in a web application directly and to provide critical insights and data without showing too much to avoid an overabundance of data. They say it is essential to balance raw data and clear insights and that different user roles might need to see different things.…”

Section: Discussionmentioning

confidence: 99%

“…In this way, it could help teachers directly notice if students have a decrease in visual focus. Breen et al (2021) implemented a virtual job interview simulator gathering and visualizing different types of data, e.g., heart rate and electrodermal activity data, to detect stress levels and eye tacking to explore visual attention patterns of autistic individuals during simulated job interview scenarios. The VE consists of an office room with an interviewer avatar sitting at a desk.…”

Section: Gaze In Virtual Environmentsmentioning

confidence: 99%

See 4 more Smart Citations

A Systematic Review of Visualization Techniques and Analysis Tools for Eye-Tracking in 3D Environments

Sundstedt

Garro

2022

Front. Neuroergonomics

View full text Add to dashboard Cite

This systematic literature review presents an update on developments in 3D visualization techniques and analysis tools for eye movement data in 3D environments. With the introduction of affordable and non-intrusive eye-tracking solutions to the mass market, access to users' gaze is now increasingly possible. As a result, the adoption of eye-tracking in virtual environments using head-mounted displays is expected to increase since the trend is to incorporate gaze tracking as part of new technical solutions. The systematic literature review presented in this paper was conducted using the Scopus database (using the period 2017 to 17th of May 2022), which after analysis, resulted in the inclusion of 15 recent publications with relevance in eye-tracking visualization techniques for 3D virtual scenes. First, this paper briefly describes the foundations of eye-tracking and traditional 2D visualization techniques. As background, we also list earlier 3D eye-tracking visualization techniques identified in a previous review. Next, the systematic literature review presents the method used to acquire the included papers and a description of these in terms of eye-tracking technology, observed stimuli, application context, and type of 3D gaze visualization techniques. We then discuss the overall findings, including opportunities, challenges, trends, and present ideas for future directions. Overall the results show that eye-tracking in immersive virtual environments is on the rise and that more research and developments are needed to create novel and improved technical solutions for 3D gaze analysis.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%