Performance of Performance Tests: Comparison of Psychometric Properties of 24 Tests from Two Microcomputer-Based Batteries

Kennedy, Robert S.; Turnage, Janet J.; Osteen, M. K.

doi:10.21236/ada252353

Cited by 3 publications

(2 citation statements)

References 21 publications

(34 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…All subtests have demonstrated reliabilities~0·707, with mean. standard deviation, and differential stability achievable in 8-12 min of practice (Kennedy et al 1989d). Collectively, the nine subtests have been demonstrated to identify four separate factors (Lane and Kennedy 1990) including: motor speed; symbol manipulation/reasoning; cognitive processing speed; and speed of response selection.…”

Section: The Automated Performance Test System (Apts)mentioning

confidence: 98%

Effects of graded dosages of alcohol on nine computerized repeated-measures tests

Kennedy¹,

Turnage²,

Wilkes³

et al. 1993

Ergonomics

Self Cite

View full text Add to dashboard Cite

We report a controlled laboratory validation experiment to provide an empirical sequel to the general background of the development of the Automated Performance Test System (APTS) that was presented in Turnage et al. (1992). The purpose of this study was to index performance deficit against various Blood Alcohol Concentrations (BACs) of small (0.05% BAC), medium (0.10% BAC), and large (0.15% BAC) dosages as well as a placebo (0.00 BAC) condition. Blood alcohol concentrations, measured in four different ways, were highly reliable and the method with the highest intercorrelation was whole blood. When taken singly, eight of the nine tests produced significant (p < 0.001) relationships with the disparate blood alcohol levels, which were essentially monotonic. A multiple regression analysis suggested that most of the tests were behaving similarly and that two or three tests accounted for 52 to 54% of the variance attributable to alcohol that was explained by the longer battery. While all tests appear valid, some of them appeared more sensitive than others (viz., code substitution, manikin, and choice reaction time). From the standpoint of these tests, greater changes occurred in cognitive function between the placebo and 0.05 level than between the 0.05 and 0.10 levels. However, the greatest reduction in performance occurred between 0.10 and 0.15, and the relatively abrupt nature of this change implies that sharp decrements in cognitive performance occur at that point. There were individual differences in resistance to alcohol, and there is strong inference that these differences would be reliable if they were tested again. We believe that further development and study of such techniques is warranted for use in fitness-for-duty testing and development of a dose equivalency index.

show abstract

Section: The Automated Performance Test System (Apts)mentioning

confidence: 98%

Effects of graded dosages of alcohol on nine computerized repeated-measures tests

Kennedy¹,

Turnage²,

Wilkes³

et al. 1993

Ergonomics

Self Cite

View full text Add to dashboard Cite

show abstract

“…Tests in these batteries have been used extensively (Kennedy & Bittner, 1977;Simmons & Kimball, 1982;Naitoh, 1982;Edwards et al, 1985;Reeves & Thorne, 1988;Semple, 1992). These tests show stable reliability and are generally viewed to be valid for the unique factor being measured by each test (Kennedy, Turnage, & Osteen, 1989;Cambridge Cognition Limited, 2005). Three of the tests below (Complex Reaction Time, Logical Reasoning, and Matching to Sample) were administered as they appear in USSOCOM's MRPM (Thomas et al, 1994;Shurtleff et al, 1994).…”

Section: Cognitive Testsmentioning

confidence: 99%

Evaluation of Several Common Antimotion Sickness Medications and Recommendations Concerning Their Potential Usefulness During Special Operations

Lawson¹,

McGee²,

Castaneda³

et al. 2009

View full text Add to dashboard Cite

Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number.

show abstract

Development of microcomputer-based mental acuity tests

Turnage¹,

Kennedy²,

Smith³

et al. 1992

Ergonomics

View full text Add to dashboard Cite

Recent disasters have focused attention on performance problems due to the use of alcohol and controlled substances in the workplace. Environmental stressors such as thermal extremes, mixed gases, noise, motion, and vibration also have adverse effects on human performance and operator efficiency. However, the lack of a standardized, sensitive, human performance assessment battery has probably delayed the systematic study of the deleterious effects of various toxic chemicals and drugs at home and in the workplace. The collective goal of the research reported here is the development of a menu of tests embedded in a coherent package of hardware and software that may be useful in repeated-measures studies of a broad range of agents that can degrade human performance. A menu of 40 tests from the Automated Performance Test System (APTS) is described, and the series of interlocking studies supporting its development is reviewed. The APTS tests, which run on several versions of laptop portables and desktop personal computers, have been shown to be stable, reliable, and factorially rich, and to have predictive validities with holistic measures of intelligence and simulator performances. In addition, sensitivity studies have been conducted in which performance changes due to stressors, agents, and treatments were demonstrated. We believe that tests like those described here have prospective use as an adjunct to urine testing for the screening for performance loss of individuals who are granted access to workplaces and stations that impact public safety.

show abstract

Performance of Performance Tests: Comparison of Psychometric Properties of 24 Tests from Two Microcomputer-Based Batteries

Cited by 3 publications

References 21 publications

Effects of graded dosages of alcohol on nine computerized repeated-measures tests

Effects of graded dosages of alcohol on nine computerized repeated-measures tests

Evaluation of Several Common Antimotion Sickness Medications and Recommendations Concerning Their Potential Usefulness During Special Operations

Development of microcomputer-based mental acuity tests

Contact Info

Product

Resources

About