A Comparison of Methods for Assessing Situation Awareness in Current Day and Future Air Traffic Management Operations: Graphics-Based vs Text-Based Online Probe Systems

Strybel, Thomas Z.; Chiappe, Dan; Vu, Kim‐Phuong L.; Miramontes, Adriana; Battiste, Henri; Battiste, Vernol

doi:10.1016/j.ifacol.2016.10.457

Cited by 6 publications

(3 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Conversely, SPAM is heavily reliant on identifiers, but this does not cause a problem because they are readily available on displays. And Strybel et al (2016) found that participants performed more poorly on SPAM with graphically presented probes as compared to verbal probes, most likely due to physical interference with the ongoing task, or potentially because they were presented in a way that made guessing less easy. In contrast, Shelton et al (2013) created a text based display for SPAM probes on a small hand-held computer because verbally presented queries interfered with normal discussions in a study with health care teams.…”

Section: Resultsmentioning

confidence: 99%

A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM

2019

View full text Add to dashboard Cite

Objective: To examine evidence of sensitivity, predictiveness, and methodological concerns regarding direct, objective measures of situation awareness (SA). Background: The ability to objectively measure SA is important to the evaluation of user interfaces and displays, training programs, and automation initiatives, as well as for studies that seek to better understand SA in both individuals and teams. A number of methodological criticisms have been raised creating significant confusion in the research field. Method: A meta-analysis of 243 studies was conducted to examine evidence of sensitivity and predictiveness, and to address methodological questions regarding Situation Awareness Global Assessment Technique (SAGAT), Situation Present Assessment Technique (SPAM), and their variants. Results: SAGAT and SPAM were found to be equally predictive of performance. SPAM (64%) and real-time probes (73%) were found to have significantly lower sensitivity in comparison to SAGAT (94%). While SAGAT was found not to be overly memory reliant nor intrusive into operator performance, SPAM resulted in problems with intrusiveness in 40% of the studies examined, as well as problems with speed-accuracy tradeoffs, sampling bias, and confounds with workload. Concerns about memory reliance, the utility of these measures for assessing Team SA, and other issues are also addressed. Conclusion: SAGAT was found to be a highly sensitive, reliable, and predictive measure of SA that is useful across a wide variety of domains and experimental settings. Application: Direct, objective SA measurement provides useful and diagnostic insights for research and design in a wide variety of domains and study objectives.

show abstract

Section: Resultsmentioning

confidence: 99%

A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM

2019

View full text Add to dashboard Cite

show abstract

“…Recollection cannot probe unconscious/implicit awareness and suffers from inaccuracies like forgetting (Nisbett & Wilson, 1977), limiting it to partial scene probing (Gugerty, 1998). Real-time probes like situation present assessment method (SPAM) (Durso & Dattel, 2004;Strybel et al, 2016) or verbal protocol methods (Salmon et al, 2014) circumvent these issues. However, the real-time communication is intrusive and limits probe rate.…”

Section: Introductionmentioning

confidence: 99%

Measuring Driver Perception: Combining Eye-Tracking and Automated Road Scene Perception

2020

View full text Add to dashboard Cite

Objective To investigate how well gaze behavior can indicate driver awareness of individual road users when related to the vehicle’s road scene perception. Background An appropriate method is required to identify how driver gaze reveals awareness of other road users. Method We developed a recognition-based method for labeling of driver situation awareness (SA) in a vehicle with road-scene perception and eye tracking. Thirteen drivers performed 91 left turns on complex urban intersections and identified images of encountered road users among distractor images. Results Drivers fixated within 2° for 72.8% of relevant and 27.8% of irrelevant road users and were able to recognize 36.1% of the relevant and 19.4% of irrelevant road users one min after leaving the intersection. Gaze behavior could predict road user relevance but not the outcome of the recognition task. Unexpectedly, 18% of road users observed beyond 10° were recognized. Conclusions Despite suboptimal psychometric properties leading to low recognition rates, our recognition task could identify awareness of individual road users during left turn maneuvers. Perception occurred at gaze angles well beyond 2°, which means that fixation locations are insufficient for awareness monitoring. Application Findings can be used in driver attention and awareness modelling, and design of gaze-based driver support systems.

show abstract

“…So far, digital work processes have been extensively analysed for air traffic controllers (Li, Kearney, Braithwaite & Lincet, 2018;Miramontes et al, 2015;Strybel et al, 2016) whereas other professional groups, such as security staff, have received only little attention (Chavaillaz, Schwaninger Michel, & Sauer, 2019). Today, customer integration is of high importance and shapes the competitiveness of airports and airlines (Milne, Delcea, Cotfas, & Salaricet, 2019;Negri, Borille, & Falcao, 2019).…”

Section: Empirical Contextmentioning

confidence: 99%

In control or out of control?

Bardmann¹,

Ruiner²,

Künzel³

et al. 2023

WOLG

View full text Add to dashboard Cite

Self-reliant digital systems (SDS) can adapt to changing circumstances and environments, evaluate complex situations, make decisions and optimise processes. In this context, work processes also change, since SDS are controlled by workers but are also partly out of control, that is, processing information independently and without worker influence. It can be expected that handling and interacting with SDS impact workers’ perception of autonomy and control and their interrelationship. This paper focuses on these developments at airports and is based on 24 interviews with airport and flight staff. The findings point to a difference between objective control and the perception of control. Moreover, we identify autonomy-enhancing and autonomy-restricting forms of control in contexts using SDS. In this sense, the article contributes to clarifying autonomy and control in the specific context of SDS at airports and conceptualising the interrelation of autonomy and control.

show abstract

A Comparison of Methods for Assessing Situation Awareness in Current Day and Future Air Traffic Management Operations: Graphics-Based vs Text-Based Online Probe Systems

Cited by 6 publications

References 10 publications

A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM

A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM

Measuring Driver Perception: Combining Eye-Tracking and Automated Road Scene Perception

In control or out of control?

Contact Info

Product

Resources

About