Experimental Validation of an Eye-Tracking-Based Computational Method for Continuous Situation Awareness Assessment in an Aircraft Cockpit

Schwerd, Simon; Schulte, Axel

doi:10.1007/978-3-030-49183-3_32

Cited by 5 publications

(4 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Speed data also demonstrated a strong positive correlation of r = .75 (significant , p < .01) with AD in speed. These findings align with a previous study with different participants that experimentally validated operator measurement in a similar task (Schwerd & Schulte, 2020).…”

Section: Resultssupporting

confidence: 92%

“…To achieve this, we introduce the concept of awareness deviation (AD), which can also be interpreted as a measure of the perceptual level of SA (Level 1) by quantifying the difference between the current state value and what the system assumes is the pilot’s last perception of each state (Endsley & Jones, 2012). The metric AD was first introduced and tested by the authors in two previous studies (Schwerd & Schulte, 2020, 2021), on the basis of which this follow-up study was developed. With this AD measure, we can alert the pilot and direct their attention to any unnoticed changes in the system state.…”

Section: Measurement Of Monitoring Performancementioning

confidence: 99%

See 1 more Smart Citation

Triggering Cockpit Alerts Using an Eye-Tracking-Based Measure of Monitoring Performance

Schwerd,

Schulte

2024

Aviation Psychology and Applied Human Factors

Self Cite

View full text Add to dashboard Cite

This study explored the potential for enhancing pilot performance via an alerting system that adapts according to an eye-tracking-based measure of monitoring. The novel measure combines gaze analysis with system state assessment to estimate the pilot’s understanding of the current system state. On this basis, an alerting system was developed to direct pilot attention to unnoticed system state changes, thereby improving system state monitoring. In a flight simulator study involving 10 participants in a generic jet cockpit, we compared the adaptive alerting system with a no-assistance condition. Although alerting improved the participants’ performance in two tracking tasks, it adversely impacted performance in a third task. Nonetheless, alerting resulted in a decrease in both variance and mean detection time of critical changes. Participants’ subjective ratings were generally positive, yet they criticized the lack of transparency of the alerting mechanism. Alerts triggered based on eye-tracking and system state show potential for improving operator task performance. Nonetheless, for the system to reach its full performance potential, it is critical that the operator understand the principles underlying the alert triggers. False positives and alert design were identified as key areas for improvement to maintain user trust and task flow.

show abstract

Section: Resultssupporting

confidence: 92%

Section: Measurement Of Monitoring Performancementioning

confidence: 99%

Triggering Cockpit Alerts Using an Eye-Tracking-Based Measure of Monitoring Performance

Schwerd,

Schulte

2024

Aviation Psychology and Applied Human Factors

Self Cite

View full text Add to dashboard Cite

show abstract

“…For velocity, the data shows a strong positive correlation of r = .75 (significant, p<.01). These results reproduce findings from a previous study where the operator measurement has been experimentally validated in a similar task (Schwerd & Schulte, 2020). Further, Figure 6 shows mean deviation and error in route tracking.…”

Section: Validation Of Operator Measurementsupporting

confidence: 88%

“…Each deviation describes the difference between the current state value and the assumed pilot's awareness. The measurement of deviation is based on eye-tracking and was developed and evaluated in two prior studies (Schwerd & Schulte, 2020. Based on this measure we alert the pilot and guide the attention towards an unnoticed change of system state.…”

Section: Deviation As a Measure Of Samentioning

confidence: 99%

Situation Awareness Adaptive Alerting in an Aircraft Cockpit: A Simulator Study

Schwerd¹,

Schulte²

2021

Preprint

Self Cite

View full text Add to dashboard Cite

The goal of this study was to develop an automated cockpit support system that is adaptive to the flight crew’s situation awareness (SA) estimated by online gaze analysis. Flight crew errors are often attributed to low SA. Online measurement of SA could be used to automatically guide the user’s attention for the sake of fewer errors and better performance.An eye-tracking based measure for SA was developed and used for the adaptive generation of alerts in a flight simulator. In an experiment, ten certified pilots conducted two trials with no and adaptive alerting. The experimental task involved tracking of flight parameters which were partially disturbed or changed at random times. Our online estimation of SA showed a strong correlation with observed pilot performance. With adaptive alerts, the average performance increased in those experimental tasks, where a situational change could not be predicted by participants. Also, adaptive alerts improved change detection and reduced the number of outliers, where a change was not noticed for an exceptionally long time. However, subjective rating was poor due to low transparency and false positives. SA-adaptive support can improve change detection performance in typical tasks on the flight deck. For a greater acceptance, pilots should be trained to understand the adaption policy.

show abstract

Experimental Assessment of Fixation-Based Attention Measurement in an Aircraft Cockpit

Schwerd

Schulte

2022

Engineering Psychology and Cognitive Ergonomics

View full text Add to dashboard Cite

Experimental Validation of an Eye-Tracking-Based Computational Method for Continuous Situation Awareness Assessment in an Aircraft Cockpit

Cited by 5 publications

References 14 publications

Triggering Cockpit Alerts Using an Eye-Tracking-Based Measure of Monitoring Performance

Triggering Cockpit Alerts Using an Eye-Tracking-Based Measure of Monitoring Performance

Situation Awareness Adaptive Alerting in an Aircraft Cockpit: A Simulator Study

Experimental Assessment of Fixation-Based Attention Measurement in an Aircraft Cockpit

Contact Info

Product

Resources

About