An Initial Test of a Normative Figure of Merit for the Quality of Overall Task Performance

Abstract

An overall indicator, or Figure Of Merit (FOM), of the quality of crew/vehicle system performance is needed to establish the effect of workload on efficiency and to identify overload conditions. A normative FOM is proposed in which performance is measured on a representative task and a normative database obtained. FOMs for subsequent executions of the task are then reported in terms of weighted deviations from average task performance. Performance of discrete tasks is measured primarily in terms of subtask time and errors. Discrete task performance is then combined with a measure of continuous vehicle control. In order to test the normative FOM procedure, the technique was applied to an existing set of data from a simulated landing task in which standard communications with ATC was compared with a data link communications system. The results indicated that while mean task performance was not affected, task variability, as measured by the FOM, was significantly higher when data link communications were used. In order to establish the sensitivity of the normative FOM method, further testing of the measure is recommended.