In an exploratory study, we examined whether communication could distinguish between high-or low-situation awareness (SA) F-15 lead pilots. With aid from an assigned wingman and an air weapons controller, the lead pilots flew 36 simulated combat engagements. Two measures of SA were utilized. First, ratings of SA were obtained from the operational squadrons. Second, subject matter experts based SA ratings of 40 lead pilots on (a) 28 critical behaviors identified in a task analysis, and (b) behaviors such as communication. Subsequent rankings from both SA measures revealed that, during the simulated engagements, high-situation awareness pilots directed team members more frequently and requested more information. Despite the varied complex simulated engagements, communication patterns were stable; lead pilots' communications were similar for identical engagements that were flown both early and late in the study. Larger studies using a correlational approach with communication categorization are suggested.

The purpose of this effort was to model expert pilot performance and decision making in one-versus-one (1v1) air-to-air combat. Several knowledge-elicitation techniques were used to extract air combat expertise from a former fighter pilot, who served as the subject-matter-expert (SME). Unstructured and then structured interviews were used to elicit the goals and sub-goals of air-to-air combat, plus some of the pilot behaviors necessary to accomplish the goals. The SME also flew a number of combat sorties against another former fighter pilot in the Simulator for Air-to-Air Combat (SAAC) to demonstrate pilot performance required to accomplish the goals of air combat. Based on the SME's verbal protocols, a group of air combat rules were developed. A rule-based production system was then designed to incorporate the resulting knowledge base. The production system was also designed to be capable of analyzing an existing data base of air combat engagements. Expert system development required additional input from the SME to identify specific values of flight parameters required by the production system. Upon completion and SME verification of the expert model, it will be validated by comparing its performance to that of our SME in simulated air-to-air combat. If the model can successfully describe expert pilot performance, the model will be used to provide diagnostic performance feedback in conjunction with SAAC training.

Identifying and measuring behaviors consistently associated with situational awareness (SA) is frequently problematic. Though subtle, a person's SA may be reflected by how he/she communicates with other members of a team. Someone with high SA may not only provide different types of communication than someone with low SA, but also may exhibit different communication patterns (e.g., to whom).In the current study, we examined the communications of F-15 lead pilots who, along with an assigned wingman and ground control intercept, flew 36 simulated combat engagements. Subject matter experts based SA ratings of 40 F-15 lead pilots on (a) 28 explicit critical behaviors identified in a task analysis and (b) implicit behaviors such as communication. Results revealed that high SA pilots (a) communicated more overall, (b) utilized their human resources more by directing more and requesting more information, and (c) were more specific regarding "to whom" they were speaking. Evaluating the communications for high and low overall ranked SA lead pilots provides insight as to how expert raters may have been influenced by observable behaviors. A follow-up study is being conducted to examine (a) if the communication patterns found here remain the same with an independent measure of SA taken from the pilots' squadrons and (b) how the communications within a team change over time. Analysis of the types and patterns of calls made may help identify who does or does not have good tactical air-to-air SA; this analysis may subsequently lead to possible training strategies to improve SA.

Identifying and measuring behaviors consistently associated with situational awareness (SA) is frequently problematic. Though subtle, a person's SA may be reflected by how he/she communicates with other members of a team. Someone with high SA may not only provide different types of communication than someone with low SA, but also may exhibit different communication patterns (e.g., to whom).In the current study, we examined the communications of F-15 lead pilots who, along with an assigned wingman and ground control intercept, flew 36 simulated combat engagements. Subject matter experts based SA ratings of 40 F-15 lead pilots on (a) 28 explicit critical behaviors identified in a task analysis and (b) implicit behaviors such as communication. Results revealed that high SA pilots (a) communicated more overall, (b) utilized their human resources more by directing more and requesting more information, and (c) were more specific regarding "to whom" they were speaking. Evaluating the communications for high and low overall ranked SA lead pilots provides insight as to how expert raters may have been influenced by observable behaviors. A follow-up study is being conducted to examine (a) if the communication patterns found here remain the same with an independent measure of SA taken from the pilots' squadrons and (b) how the communications within a team change over time. Analysis of the types and patterns of calls made may help identify who does or does not have good tactical air-to-air SA; this analysis may subsequently lead to possible training strategies to improve SA.