Exploring Short-Term Training Effects of Ecological Interfaces: A Case Study in Air Traffic Control

Borst, Clark; Visser, R.M.; Paassen, M. M. van

doi:10.1109/thms.2019.2919742

Cited by 12 publications

(5 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The question may arise as to whether augmented displays like the SSD represent what they intend to represent. Borst et al (2019) stated that the SSD “portrays velocity obstacles (or, conflict zones) in speed and heading within the maneuvering envelope of the aircraft under control” (p. 624). An important question is whether people indeed see “velocity obstacles” and not merely “lines and a red shape” without further understanding of the work domain.…”

Section: Discussionmentioning

confidence: 99%

Augmented Visual Feedback: Cure or Distraction?

et al. 2020

Self Cite

View full text Add to dashboard Cite

Objective The aim of the study was to investigate the effect of augmented feedback on participants’ workload, performance, and distribution of visual attention. Background An important question in human–machine interface design is whether the operator should be provided with direct solutions. We focused on the solution space diagram (SSD), a type of augmented feedback that shows directly whether two aircraft are on conflicting trajectories. Method One group of novices ( n = 13) completed conflict detection tasks with SSD, whereas a second group ( n = 11) performed the same tasks without SSD. Eye-tracking was used to measure visual attention distribution. Results The mean self-reported task difficulty was substantially lower for the SSD group compared to the No-SSD group. The SSD group had a better conflict detection rate than the No-SSD group, whereas false-positive rates were equivalent. High false-positive rates for some scenarios were attributed to participants who misunderstood the SSD. Compared to the No-SSD group, the SSD group spent a large proportion of their time looking at the SSD aircraft while looking less at other areas of interest. Conclusion Augmented feedback makes the task subjectively easier but has side effects related to visual tunneling and misunderstanding. Application Caution should be exercised when human operators are expected to reproduce task solutions that are provided by augmented visual feedback.

show abstract

Section: Discussionmentioning

confidence: 99%

Augmented Visual Feedback: Cure or Distraction?

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…Eighteen participants (2 female and 16 male, average age 27 years) were selected, all students and staff members of TU Delft Aerospace Engineering. All participants had experience with ATC through coursework and were aware of best practices through participating in earlier experiments featuring the same simulation environment [35]. No professional controllers participated because of their limited availability and the fact that the experiment uses a future concept of operation (i.e., the novel interface, no RT but direct manipulation, the adaptive support), which could make it challenging to obtain usable data when experienced controllers are making comparisons to current operations.…”

Section: Participants and Instructionsmentioning

confidence: 99%

Evaluation of a Decision-Based Invocation Strategy for Adaptive Support for Air Traffic Control

IJtsma

Borst

Paassen

2022

IEEE Trans. Human-Mach. Syst.

Self Cite

View full text Add to dashboard Cite

Air traffic controller workload is a limiting factor in the current air traffic management system. Adaptive support systems have the potential to balance controller workload and gain acceptance as they provide support during times of need. Challenges in the design of adaptive support systems are to decide when and how to trigger support. The goal of this study is to gain empirical insights into these challenges through a human-in-theloop experiment, featuring a simplified air traffic control environment in which a novel triggering mechanism uses the quality of the controller's decisions to determine when support is needed. The designed system seeks to prevent high workload conditions by providing resolution advisories when the controller exceeds a threshold of "self-complicating" decisions. Results indicate that the new system is indeed capable of increasing the efficiency and safety compared to full manual control without intervention. More adaptive support, however, increased the frustration of participants, decreased acceptance, and did not result in improved workload ratings. These findings suggest that, unless we can better infer human intent in complex work environments, adaptive support at the level of decision-making is problematic. A potentially more fruitful direction is to provide support at the level of information integration, with full decision-making authority with the human.

show abstract

“…In the domain of ATC, Borst et al [BVVPM16, BVVPM19] explored short term training effects of an EID‐based solution space diagram concept on novices' knowledge development and performance in CD&R tasks. It was however limited to horizontal solution spaces and heading (HDG) clearances.…”

Section: Related Workmentioning

confidence: 99%

Exploring Effects of Ecological Visual Analytics Interfaces on Experts' and Novices' Decision‐Making Processes: A Case Study in Air Traffic Control

Zohrevandi

Westin

Vrotsou

et al. 2022

Computer Graphics Forum

View full text Add to dashboard Cite

Operational demands in safety‐critical systems impose a risk of failure to the operators especially during urgent situations. Operators of safety‐critical systems learn to make decisions effectively throughout extensive training programs and many years of experience. In the domain of air traffic control, expensive training with high dropout rates calls for research to enhance novices' ability to detect and resolve conflicts in the airspace. While previous researchers have mostly focused on redesigning training instructions and programs, the current paper explores possible benefits of novel visual representations to improve novices' understanding of the situations as well as their decision‐making process. We conduct an experimental evaluation study testing two ecological visual analytics interfaces, developed in a previous study, as support systems to facilitate novice decision‐making. The main contribution of this paper is threefold. First, we describe the application of an ecological interface design approach to the development of two visual analytics interfaces. Second, we perform a human‐in‐the‐loop experiment with forty‐five novices within a simplified air traffic control simulation environment. Third, by performing an expert‐novice comparison we investigate the extent to which effects of the proposed interfaces can be attributed to the subjects' expertise. The results show that the proposed ecological visual analytics interfaces improved novices' understanding of the information about conflicts as well as their problem‐solving performance. Further, the results show that the beneficial effects of the proposed interfaces were more attributable to the visual representations than the users' expertise.

show abstract

Exploring Short-Term Training Effects of Ecological Interfaces: A Case Study in Air Traffic Control

Cited by 12 publications

References 21 publications

Augmented Visual Feedback: Cure or Distraction?

Augmented Visual Feedback: Cure or Distraction?

Evaluation of a Decision-Based Invocation Strategy for Adaptive Support for Air Traffic Control

Exploring Effects of Ecological Visual Analytics Interfaces on Experts' and Novices' Decision‐Making Processes: A Case Study in Air Traffic Control

Contact Info

Product

Resources

About