The selection of air traffic control specialists: I. History and review of contributions by the Civil Aeromedical Institute

Boone, James O; Collins, William E.; VanDeventer, Allan D.

doi:10.1037/e502922009-001

Cited by 6 publications

(6 citation statements)

References 16 publications

(74 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Research, as summarized by Collins, Boone, and VanDeventer (1984), continued through the late 1970s to improve the predictive validity and efficiency of the written test battery. For example, Buckley and Beebe (1970) developed the Controller Decision Evaluation (CODE) test, which consisted of a film of a computer simulation of air traffic movement across a radar scope.…”

Section: Atcs Selection In the United States Atcs Selection 1976 -199mentioning

confidence: 99%

Review of Air Traffic Controller Selection: An International Perspective

Broach¹,

Manning²

1997

PsycEXTRA Dataset

View full text Add to dashboard Cite

This report provides a review of research on air traffic controller selection in the United States, Germany, the United Kingdom, and Sweden. The development and validation of the multiple hurdle selection system used by the US Federal Aviation Administration (FAA) from 1976 through 1992 is described first. The computeradministered test battery that supplanted the second-stage screening conducted at the FAA Academy is discussed next. Work by Eißfeldt for the German Air Navigation Services at the Aerospace Research Establishment (DLR) in Hamburg is reviewed. Job analysis, test battery development, and validation research for the controller occupation in the United Kingdom is presented next, followed by a description of the Swedish "MRU Project" on controller selection. The report closes with a discussion of issues surrounding controller job performance measurement. The advantages and disadvantages of historical criteria, such as training records, are reviewed. Alternative approaches to job performance measurement, such as simulations and operational data replay and analysis, are then described. The report closes with suggestions for future directions in controller selection research.

show abstract

Section: Atcs Selection In the United States Atcs Selection 1976 -199mentioning

confidence: 99%

Review of Air Traffic Controller Selection: An International Perspective

Broach¹,

Manning²

1997

PsycEXTRA Dataset

View full text Add to dashboard Cite

show abstract

“…In order to assess the difference between these two weighting methods (WT 1 and WT 2 ), correlation coefficients were computed between the two weighted scores on the experimental battery and between those and the scores on the CSC battery which were also available for the ATC trainees. Since the weighting used to examine the utility of the experimental test battery (WT2) had a slightly higher correlation with the CSC battery than the battery (WT 1 ) (.65 compared to .62), the results should tend to be somewhat more conservative than if the analysis were based on weighting factors identified in WT 1 .…”

Section: Test Utilitymentioning

confidence: 99%

“…Pickrel (1979) has used per-, formance measures to establish pass-fail cut-offs for Academy training and has urged the use of Controller Skills Tests to support the reliability and validity of laboratory scores. Collins, Boone, and VanDeventer (1980, See Chapter 3) have discussed the objective criterion problem in their report on contributions by the Civil Aeromedical Institute. Tucker (1981) has been investigating the feasibility of using paper-and-pencil microsimulations for objective skills testing both at the FAA Academy and at air traffic control facilities; a further discussion of this work is presented in Chapter 12.…”

mentioning

confidence: 99%

Selection of Air Traffic Controllers

Sells¹,

Dailey²,

Pickrel³

1984

PsycEXTRA Dataset

View full text Add to dashboard Cite

“…The development of the written ATCS aptitude test battery has been extensively described elsewhere (Brokaw, 1984;Collins, Boone, & VanDeventer, 1984;Manning, 1991;Sells, 1984;Sells, Dailey, & Pickrel, 1984). The test-retest correlation for the MCAT was estimated at .60 in a sample of 617 newly hired controllers (Rock, Dailey, Ozur, Boone, & Pickrel, 1982, p. 59).…”

Section: Methodsmentioning

confidence: 99%

Guidelines for bootstrapping validity coefficients in ATCS selection research.

Russell¹,

Dean²,

Broach³

2000

PsycEXTRA Dataset

View full text Add to dashboard Cite

This technical report 1) reviews the literature on bootstrapping estimation procedures and potential applications to the selection of air traffic control specialists (ATCSs), 2) describes an empirical demonstration of procedures for estimating the sample size required to demonstrate criterion-related validity in ATCS selection, and 3) provides summary guidelines and recommendations for estimating sample size requirements in ATCS selection test validation using bootstropping procedures under conditions of direct and indirect range restriction. Bootstrapping estimates the sampling distribution of a statistic by iteratively resampling cases from a set of observed data. Confidence intervals are constructed for the statistic, providing an empirical basis for inferential statements about the likley magnitude of the statistic. Correlations between scores on the written ATCS aptitude test battery and subsequent performance in initial qualification training for a large sample of 10,869 controllers hired between 1986 and 1992 were bootstrapped in an empirical demonstration of the methodology. Finally, a three-step sequence of procedures is described for use in future bootstrap estimates of confidence intervals. Recommendations for sample size requirements in future ATC criterion validity studies include: 1. Results suggest samples of at least N= 175 to ensure the 90% confidence interval for r does not contain 0. 2. Assumptions of bivariate normality in traditional parametric estimation procedures are not justified in the current data. Note that this observation may result in confidence intervals that are wider or narrower for any given sample size than intervals obtained from traditional parametric estimation. 3. Corrections for direct range restriction did not substantively influence whether the bootstrapped 90% confidence interval contained 0. Future applications should assess whether this holds true. 4. Given the apparent absence of bivariate normality in the current data, similar bootstrapping procedures should be used to assess whether the 90% confidence intervals for p -p o and R rjax2 -R YX1 contain 0. Overall, the results suggest that bootstrapping of validity coefficients in controller selection research may be technically feasible. However, legal considerations may limit practical use of the methodology until accepted professional guidelines, standards, and principles are revised to accommodate innovative methodologies. Key WordsBootstrapping; Validity; Air Traffic Control Specialist Selection

show abstract

The selection of air traffic control specialists: I. History and review of contributions by the Civil Aeromedical Institute

Cited by 6 publications

References 16 publications

Review of Air Traffic Controller Selection: An International Perspective

Review of Air Traffic Controller Selection: An International Perspective

Selection of Air Traffic Controllers

Guidelines for bootstrapping validity coefficients in ATCS selection research.

Contact Info

Product

Resources

About