Examining 3-month test-retest reliability and reliable change using the Cambridge Neuropsychological Test Automated Battery

Abstract

The Cambridge Neuropsychological Test Automated Battery (CANTAB) is a battery of computerized neuropsychological tests commonly used in Europe in neurology and psychiatry studies, including clinical trials. The purpose of this study was to investigate test-retest reliability and to develop reliable change indices and regression-based change formulas for using the CANTAB in research and practice involving repeated measurement. A sample of 75 healthy adults completed nine CANTAB tests, assessing three domains (i.e., visual learning and memory, executive function, and visual attention) twice over a 3-month period. Wilcoxon signed-rank tests showed significant practice effects for 6 of 14 outcome measures with effect sizes ranging from negligible to medium (Hedge's g: .15-.40; Cliff's delta: .09-.39). The Spatial Working Memory test, Attention Switching Task, and Rapid Visual Processing test were the only tests with scores of adequate test-retest reliability. For all outcome measures, Pearson's and Spearman's correlation coefficients ranged from .39 to .79. The measurement error surrounding difference scores was large, thus requiring large changes in performance (i.e., 1-2 SDs) in order to interpret a change score as reliable. In the regression equations, test scores from initial testing significantly predicted retest scores for all outcome measures. Age was a significant predictor in several of the equations, while education was a significant predictor in only two of the equations. The adjusted R 2 values ranged between .19 and .67. The present study provides results enabling clinicians to make probabilistic statements about change in cognitive functions based on CANTAB test performances.

Examining Test-Retest Reliability and Reliable Change for Cognition Endpoints for the CENTER-TBI Neuropsychological Test Battery

“…The test-retest correlations for the other composites fell in the low or marginal category. A test-retest correlation of 0.87 is considerable higher than the test-retest correlations for the individual tests in the present study (Table 5) and for most of the tests in the CANTAB battery (40)(41)(42)(43).…”

Cognitive Functioning and Schizotypy: A Four-Years Study

“…On the other hand, response inhibition and aspects of cued attention switching, set-shifting as well as phonemic and semantic verbal fluency improved at follow-up compared with baseline, although the effect of time on set-shifting was abolished in the “schizotypy congruent” sub-group probably due to the smaller sample size. Even though there are findings supporting the stability of these cognitive functions over time ( 93 , 97 – 99 ), there is also evidence indicating that performance in the tasks employed here is subject to practice effects resulting in improved performance ( 99 – 103 ). The majority of these studies include assessments at shorter time-intervals than in the present one; however, there are findings supporting the persistence of these effects at time intervals comparable to the 4-years of our follow-up assessment ( 104 – 106 ).…”

Recovery of High Interference Memory in Spite of Lingering Cognitive Deficits in a Longitudinal Pilot Study of Hospitalized Depressed Patients

“…There are well documented practice effects on many of the CANTAB tests [see e.g. Karlsen et al ( 43 )]. However, practice effects, if anything, should work against our ability to detect impairments in remitted patients’ cognitive performance.…”