The influence of training level on manual flight in connection to performance, scan pattern, and task load

Abstract

This work focuses on the analysis of pilots’ performance during manual flight operations in different stages of training and their influence on gaze strategy. The secure and safe operation of air traffic is highly dependent on the individual performances of the pilots. Before becoming a pilot, he/she has to acquire a broad set of skills by training to pass all the necessary qualification and licensing standards. A basic skill for every pilot is manual control operations, which is a closed-loop control process with several cross-coupled variables. Even with increased automation in the cockpit, the manual control operations are essential for every pilot as a last resort in the event of automation failure. A key element in the analysis of manual flight operations is the development over time in relation to performance and visual perception. An experiment with 28 participants (including 11 certified pilots) was conducted in a Boeing 737 simulator. For defined flight phases, the dynamic time warping method was applied to evaluate the performance for selected criteria, and eye-tracking methodology was utilized to analyze the gaze-pattern development. The manipulation of workload and individual experience influences the performance and the gaze pattern at the same time. Findings suggest that the increase of workload has an increased influence on pilots depending on the flight phase. Gaze patterns from experienced pilots provide insights into the training requirements of both novices and experts. The connection between workload, performance and gaze pattern is complex and needs to be analyzed under as many differing conditions. The results imply the necessity to evaluate manual flight operations with respect to more flight phases and a detailed selection of performance indications.

A methodology to detect pilot perception of warning information by eye movement data and deep residual shrinkage networks

“…When evaluating the relationship between humans and equipment through eye-tracking devices, eye movement data were used to analyse human behaviours. This hypothesis was confirmed by many previous researchers [14], such as mental fatigue [15], cognitive load [16], information acquisition [17], situational awareness [18], scanning behaviours [19], attention [20], physiological measurements [21], workload [22, 23], interface evaluation and human-computer interaction [24, 25]. Research on eye movement data that predicted pilots’ behaviour included how different role assignments influenced decisions in high-risk environments, and how to predict pilots’ decisions by paying attention to relevant information about pilots’ choices [26].…”

“…scanning behaviours [19], attention [20], physiological measurements [21], workload [22,23], interface evaluation and human-computer interaction [24,25].Research on eye movement data that predicted pilots' behaviour included how different role assignments influenced decisions in high-risk environments, and how to predict pilots' decisions by paying attention to relevant information about pilots' choices [26]. When using eye movement to predict dangerous situations, Francisco [27] found that saccade, gaze, blink and gaze dispersion in horizontal and vertical dimensions in eye movement features were more likely to predict the occurrence of dangerous situations.…”

Influencing factors of novice pilot SA based on DEMATEL-AISM method: From pilots’ view

“…The increase in task complexity can easily lead to the decline of novice pilots' information perception and rapid response, making novice pilot exposed to SA deterioration and safety risk growth [ 53 , 54 ]. Researchers are trying to develop various training methods [ 55 , 56 ], including optimizing pilot's visual attention mode [ 57 , 58 ], promoting pilot's mental state [ 59 , 60 ], enhancing aircrew communication and cooperation [ 33 ], etc. The training methods can help novice pilot to maintain the abilities of efficient perception, appropriate decision-making, and dynamic adaptation stably, thus ensuring optimal performance and flight safety [ 61 , 62 ].…”