An Application of Signal Detection Theory to Air Combat Training

Eubanks, James L.; Killeen, Peter R.

doi:10.1177/001872088302500411

Cited by 9 publications

(4 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These improvements included quicker first shots shot, more valid shots, and fewer missed shot opportunities. Eubanks and Killeen (1983) conducted a more detailed analysis of these data using signal detection theory. This subsequent analysis indicated that TAC ACES training significantly changed the pilot's bias or willingness to employ weapons.…”

Section: Air-to-air Combat Trainingmentioning

confidence: 99%

Evaluating the Effectiveness of Flight Simulators for Training Combat Skills: A Review

Bell¹,

Waag²

1998

The International Journal of Aviation Psychology

View full text Add to dashboard Cite

Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. The military is focusing a great deal of effort on developing virtual world technologies that will allow training combat skills in flight simulators. Considerably less attention is being directed toward documenting the effectiveness of such training. In this article, we review Air Force and Navy efforts to evaluate the effectiveness of training the combat skills necessary for attack and fighter aircraft in flight simulators. The majority of these efforts indicate that simulation can be a valuable complement to the aircraft. Unfortunately, this conclusion is based primarily on opinion data from experienced aviators. REPORT DATEThere are very few transfer of training experiments, and those experiments have examined only a limited set of combat tasks. We also describe the typical paradigms used to conduct training evaluations and outline a multistep evaluation program for determining training effectiveness.

show abstract

Section: Air-to-air Combat Trainingmentioning

confidence: 99%

Evaluating the Effectiveness of Flight Simulators for Training Combat Skills: A Review

Bell¹,

Waag²

1998

The International Journal of Aviation Psychology

View full text Add to dashboard Cite

show abstract

“…As a further refinement of this type of measure, Eubanks and Killeen (1983) and Amburn (1994) have suggested that the probe be structured with "yes-no" responses in order to permit information-theoretic analyses. In effect, since each response reflects a "positive hit" (a correct yes answer), a "negative hit" (a correct no answer), a "positive miss" (an incorrect no answer), or "false alarm" (an incorrect yes answer), the data lend themselves to a 2-by-2 matrix.…”

Section: Approach To Measuring Environmental Status Awarenessmentioning

confidence: 99%

“…Such "awareness" is typically probed either with retrospective or concurrent "explicit" measures of SA (Fracker, 1991). Because there is some controversy concerning whether retrospective (after-themission) measures confound momentary and reflective SA, the concurrent measurement approach was incorporated into the SAFTE system, as described below.As a further refinement of this type of measure, Eubanks and Killeen (1983) and Amburn (1994) have suggested that the probe be structured with "yes-no" responses in order to permit information-theoretic analyses. In effect, since each response reflects a "positive hit" (a correct yes answer), a "negative hit" (a correct no answer), a "positive miss" (an incorrect no answer), or "false alarm" (an incorrect yes answer), the data lend themselves to a 2-by-2 matrix.…”

mentioning

confidence: 99%

Development of the Situation Awareness Flight Training and Simulation Evaluation (SAFTE) System: II: Final Development, Initial Test, and Documentation of the System

O'Donnell¹,

Moise²,

Smith³

et al. 1999

View full text Add to dashboard Cite

Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data scurces, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of ABSTRACT (Maximum 200 words)A technology has been developed for incorporating situation awareness (SA) measures into an inexpensive flight simulator. In this Phase II report, the final configuration of the simulator is described in detail, the first demonstration project to determine its training and psychometric characteristics is documented, and extensive hardware/software descriptions are provided. This Situation Awareness Flight Trainer Evaluator (SAFTh) system permits an experimenter to present operationally-relevant portions of aircraft missions in a laboratory, desk-top environment, while obtaining measures of the operator's SA embedded within the simulation. Measures of SA include spatial disorientation, awareness of aircraft present and predicted position, and several experimental metrics. In addition to the initial development, a modified SAFTE system was implemented into a human centrifuge at Brooks AFB to assess the impact of acceleration forces on pilot performance, and this development is described. Conclusions and recommendations concerning the further evolution of the SAFTE system include an assessment of the experimental SA metrics, addition of skill measures other than SA, and an evaluation of the value of this type of training for novice pilots.14. SUBJECT TERMS The authors would like to thank the two pilot consultants who contributed to this effort: Mr. William Ercoline, from Krug, International, and Mr. Robert Shaw, of FCI Associates, Incorporated. The professional input of these experienced pilots was critical in all phases of the effort, particularly in the development of the flight simulator.We are also indebted to Dr. Warren Jensen, Medical Director of the Center for Aerospace Studies of the University of North Dakota, for his assistance in obtaining subjects and handling many of the technical details for the demonstration study. INTRODUCTIONThe issue of how to define "situation awareness"-let alone how to measure it -has perplexed the scientific and operational communities for many years. In fact, General Merrill A. McPeak, former USAF Chief of Staff, has stated "...I know it when I see it..." but "Can it be measured objectively?..Can it be learned?" (letter, 17 July, 1991, SG/XO). This interest at the highest levels of command stems from the growing belief that situation awareness (SA) is a major contributor to both mission failure and accidents. Endsley (1988) cited SA as the most important factor in improving mission effectiveness. Hartell, Smith, and Prince (1991) reported that a lack of SA was given most often as the causal factor in 175 aircraft mishaps due to human error. Government, university and industry researchers have stru...

show abstract

“…SDT is related to quantify the discriminability of data that are generated by a known process (called ‘stimulus’ in humans, ‘signal’ in engineering) from background noise of the system. SDT has many applications in areas such as military, telecommunications, psychology and medical diagnosis . In medical applications, SDT provides a measurement of appropriate decision in ‘response’ to ‘stimulus’.…”

Section: Introductionmentioning

confidence: 99%

Signal detection theory approach to gastroesophageal reflux disease: a new method for symptom analysis of impedance-pH data

et al. 2013

View full text Add to dashboard Cite

An accurate reflux-symptom relationship analysis method is an unmet need in gastroesophageal reflux disease (GERD) diagnosis. The aim of this study was to adapt signal detection theory (SDT) approach to reflux-symptom relationship analysis to develop a new diagnosis method. Patients with predominant symptoms of heartburn and regurgitation were enrolled. Proton pump inhibitor (PPI)-responsive and PPI-unresponsive groups were created via interview and PPI trial. Patients then underwent stationary esophageal manometry and 24-hour multichannel intraluminal impedance-pH monitoring. SDT measurement parameters (discriminability: d' and criterion: c) were calculated using empirically selected time windows (0.5, 1, 2, 3, 4 and 5 minutes). The time window that provided the highest d' value was selected as the optimal time window. A cut-off d' value that optimally separates two groups was found using receiver operating characteristics analysis. Sixty-three patients completed the study (45 PPI responsive). Optimal time window and cut-off d' value were found as 1 and 0.767 minute, respectively. Symptom association probability (SAP) index values showed good correlation (rS = 0.7182, P < 0.0001) with d' values. SDT approach to reflux-symptom relationship analysis showed sensitivity (89% vs. 78%) and negative predictive values (75% vs. 60%) favorable over SAP index analysis. SDT approach using 1-minute time window and 0.767 cut-off d' value provides us a new and more accurate measure of reflux-symptom relationship than SAP index analysis.

show abstract

An Application of Signal Detection Theory to Air Combat Training

Cited by 9 publications

References 4 publications

Evaluating the Effectiveness of Flight Simulators for Training Combat Skills: A Review

Evaluating the Effectiveness of Flight Simulators for Training Combat Skills: A Review

Development of the Situation Awareness Flight Training and Simulation Evaluation (SAFTE) System: II: Final Development, Initial Test, and Documentation of the System

Signal detection theory approach to gastroesophageal reflux disease: a new method for symptom analysis of impedance-pH data

Contact Info

Product

Resources

About