May I Interrupt? The effect of SPAM Probe Questions on Air Traffic Controller Performance

Keeler, Jillian; Battiste, Henri; Hallett, Elyse C.; Roberts, Zach; Winter, Alice; Sanchez, Karen; Strybel, Thomas Z.; Vu, Kim‐Phuong L.

doi:10.1016/j.promfg.2015.07.843

Cited by 1 publication

(2 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on these studies, SPAM appears to create significant interference with performance and increases operator workload. Keeler et al (2015) implemented SPAM with computerized queries rather than verbal queries, similarly to Bacon and Strybel (2013) and Silva et al (2013). None of these 3 studies found SPAM to be intrusive.…”

Section: Intrusivenessmentioning

confidence: 99%

“…While the time to accept a probe is a secondary workload indicator, this ability to delay answering probes, or to ignore them completely, creates a bias in the measure in favor of lower workload periods. While Bacon and Strybel (2013), Silva et al (2013), and Keeler et al, (2015) reported that instructing participants to only answer SPAM queries if they felt able to and providing computerized SPAM queries rather than verbal queries could reduce SPAM intrusiveness, this method also systematically skews SA probes into low-workload periods.…”

Section: Sampling Biasmentioning

confidence: 99%

See 1 more Smart Citation

A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM

2019

View full text Add to dashboard Cite

Objective: To examine evidence of sensitivity, predictiveness, and methodological concerns regarding direct, objective measures of situation awareness (SA). Background: The ability to objectively measure SA is important to the evaluation of user interfaces and displays, training programs, and automation initiatives, as well as for studies that seek to better understand SA in both individuals and teams. A number of methodological criticisms have been raised creating significant confusion in the research field. Method: A meta-analysis of 243 studies was conducted to examine evidence of sensitivity and predictiveness, and to address methodological questions regarding Situation Awareness Global Assessment Technique (SAGAT), Situation Present Assessment Technique (SPAM), and their variants. Results: SAGAT and SPAM were found to be equally predictive of performance. SPAM (64%) and real-time probes (73%) were found to have significantly lower sensitivity in comparison to SAGAT (94%). While SAGAT was found not to be overly memory reliant nor intrusive into operator performance, SPAM resulted in problems with intrusiveness in 40% of the studies examined, as well as problems with speed-accuracy tradeoffs, sampling bias, and confounds with workload. Concerns about memory reliance, the utility of these measures for assessing Team SA, and other issues are also addressed. Conclusion: SAGAT was found to be a highly sensitive, reliable, and predictive measure of SA that is useful across a wide variety of domains and experimental settings. Application: Direct, objective SA measurement provides useful and diagnostic insights for research and design in a wide variety of domains and study objectives.

show abstract

Section: Intrusivenessmentioning

confidence: 99%

Section: Sampling Biasmentioning

confidence: 99%