Human-System Performance Measurement in Training Simulators

Abstract

Automated human-system performance measurement subsystems are being specified as a requirement in modern training simulators. Although hardware and software technology can support this requirement, there are many unanswered questions about the design of real-time automated measurement systems. Fundamental performance measurement problems and research issues are discussed.

An Information Processing Classification of Beyond-Visual-Range Air Intercepts

“…In the same vein, Vreuls and Obermayer (1985) offered several practical suggestions for measuring complex human performance that we have followed in our approach to the present research: (a) conduct a thorough frontend analysis of behavioral requirements and cognitive processing of the task at hand, (b) specify expected levels of expert performance in the operational environment, and (c) use the expertise of subject matter experts (SME) throughout the research, including measuring performance through the development of structured observational techniques.…”

“…Performance measurement research, in particular, has been troubled by several persistent and fundamental problems: (a) determining the covert aspects of cognition that affect complex human performance, (b) developing general theories of human performance that are applicable to real-world tasks, and (c) establishing criteria to assess operational performance under naturalistic task conditions (Jones, Hennessy, & Deutsch, 1985;Vreuls & Obermayer, 1985).…”

Re-viewing reality: human factors of synthetic training environments

“…In this way, training feedback can be delivered on-line and in real time to enhance the training process . Vreuls and Obermayer (1985) advocate that measurement information for feedback and performance diagnosis must be provided in real, or near-real, time if it is to be useful for training.…”

Research Prospectus for the Simulator Training Research Advanced Testbed for Aviation

“…Thus the development of the automated performance measurement system (PMS) has lagged behind the rapid evolution of simulators (see Kelley, 1988;and Vreuls and Obermayer, 1985, for a review of P3S research).…”