Retest reliability in adolescents of a computerized neuropsychological battery used to assess recovery from concussion

Segalowitz, Sidney J.; Mahaney, Patrick; Santesso, Diane L.; MacGregor, Leslie; Dywan, Jane; Willer, Barry

doi:10.3233/nre-2007-22310

Cited by 53 publications

(17 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We found the Ped‐ANAM to have moderate to substantial reproducibility when completed within 1 day, which is similar to what has been reported for the original (adult) ANAM (36). Furthermore, it has been suggested previously that the performance of test takers improves most between the first and second administrations, with marginal improvement upon a third administration (37) on the same day.…”

Section: Discussionsupporting

confidence: 86%

Validation of the Pediatric Automated Neuropsychological Assessment Metrics in childhood‐onset systemic lupus erythematosus

Brunner

Klein‐Gitelman

Zelko

et al. 2013

Arthritis Care & Research

View full text Add to dashboard Cite

Objective To evaluate the reproducibility and validity of the Pediatric Automated Neuropsychological Assessment Metrics (Ped-ANAM) when used in childhood-onset systemic lupus erythematosus (cSLE). Methods Forty children with cSLE and 40 matched controls were followed for up to 18 months. Formal neuropsychological testing at baseline was repeated after 18 months of follow-up; overall cognitive performance and domain-specific cognition (attention, working memory, processing speed and visuoconstructional ability) were measured and categorized as having normal cognition, mild/moderate or moderate/severe impairment. The 10 Ped-ANAM subtests were completed every 6 months and twice at baseline. Ped-ANAM performance was based on accuracy (AC), mean time to correct response (MNc), throughput, and coefficient of variation of the time required for a correct response (CVc) as a measure of response consistency. Results Particularly MNc scores demonstrated moderate to substantial reproducibility (intraclass correlation coefficients: 0.47-0.80). Means of select Ped-ANAM scores (MNc, AC, CVc) differed significantly between children with different levels of cognitive performance and allowed for the detection of moderate or severe cognitive impairment with 100% sensitivity and 86% specificity. Six Ped-ANAM subtests significantly correlated with the change in overall cognitive function in cSLE (baseline vs. 18 month; Spearman correlation coefficient > ±0.4; p<0.05, n=24). Conclusions The Ped-ANAM has moderate to substantial reproducibility, criterion and construct validity and may be responsive to change in cSLE. Additional research is required to confirm the Ped-ANAM's outstanding accuracy in identifying cognitive impairment and its usefulness in detecting clinically relevant changes in cognition over time.

show abstract

Section: Discussionsupporting

confidence: 86%

Validation of the Pediatric Automated Neuropsychological Assessment Metrics in childhood‐onset systemic lupus erythematosus

Brunner

Klein‐Gitelman

Zelko

et al. 2013

Arthritis Care & Research

View full text Add to dashboard Cite

show abstract

“…A pediatric version of ANAM has been developed for use with younger individuals. To date, most of the studies evaluating the Ped‐ANAM have been conducted in cSLE and children with concussion . The Ped‐ANAM battery comprises original ANAM tests modified to include age‐appropriate stimuli and testing procedures (e.g., reading level lowered, test stimuli and instructions simplified, and increased time allowed to respond, etc.…”

Section: Introductionmentioning

confidence: 99%

Challenges of Diagnosing Cognitive Dysfunction With Neuropsychiatric Systemic Lupus Erythematosus in Childhood

AlEed

Vega‐Fernandez

Muscal

et al. 2017

Arthritis Care & Research

View full text Add to dashboard Cite

The diagnosis of Neuropsychiatric systemic lupus erythematosus disease (NPSLE) is challenging. The Automated Neuropsychological Assessment Metrics (ANAM) has been shown to be an accessible and promising tool for evaluating possible NPSLE in adult and childhood lupus. In this review, we present information about the development and use of Ped-ANAM; the benefit of using Ped-ANAM in children with and without NPSLE in the assessment and follow up of their disease condition; and the correlation of Ped-ANAM to imaging studies such as magnetic resonance imaging (MRI). PedANAM was validated in children with cSLE in different studies. Cognitive performance can be a challenging clinical feature to efficiently assess. However, research with the Ped-ANAM has produced a Cognitive Performance Score (CPS) that allows for a reliable and efficient estimation of cognitive ability and the presence of cognitive limitations that children with cSLE may show. Compared with traditional neurocognitive assessment tools, Ped-ANAM-CPS offers a promising alternative to overcome the difficulties that practitioners previously faced.

show abstract

“…Using a short test-retest interval, such as 1 week, is helpful in identifying when scores stabilize over time and identifying whether a second test administration is needed to stabilize scores on specific measures. 6 , 20 , 23 …”

mentioning

confidence: 99%

Test-Retest Reliability of a Computerized Concussion Test

Littleton

Guskiewicz

2015

Sports Health

View full text Add to dashboard Cite

Background:Neurocognitive testing is an important concussion evaluation tool, but for neurocognitive tests to be useful, their psychometric properties must be well established. Test-retest reliability of computerized neurocognitive tests can influence their clinical utility. The reliability for a commonly used computerized neurocognitive test, CNS Vital Signs, is not well established. The purpose of this study was to examine test-retest reliability and reliable change indices for CNS Vital Signs in a healthy, physically active college population.Hypothesis:CNS Vital Signs yields acceptable test-retest reliability, with greater reliability between the second and third test administration compared with between the first and second administration.Study Design:Cohort study.Level of Evidence:Level 3.Methods:Forty healthy, active volunteers (16 men, 24 women; mean age, 21.05 ± 2.17 years) reported to a clinical laboratory for 3 sessions, 1 week apart. At each session, participants were administered CNS Vital Signs. Outcomes included standard scores for the following CNS Vital Signs domains: verbal memory, visual memory, psychomotor speed, cognitive flexibility, complex attention, processing speed, reaction time, executive functioning, and reasoning.Results:Participants performed significantly better on the second session and/or third session than they did on the first testing session on 6 of 9 neurocognitive domains. Pearson r test-retest correlations between sessions ranged from 0.11 to 0.87. Intraclass correlation coefficients ranged from 0.10 to 0.86.Conclusion:Clinicians should consider using reliable change indices to account for practice effects, identify meaningful score changes due to pathology, and inform clinical decisions.Clinical Relevance:This study highlights the importance of clinicians understanding the psychometric properties of computerized neurocognitive tests when using them in the management of sport-related concussion. If CNS Vital Signs is administered twice within a small time frame (such as 1 week), athletes should be expected to improve between the first and second administration.

show abstract

Retest reliability in adolescents of a computerized neuropsychological battery used to assess recovery from concussion

Cited by 53 publications

References 25 publications

Validation of the Pediatric Automated Neuropsychological Assessment Metrics in childhood‐onset systemic lupus erythematosus

Validation of the Pediatric Automated Neuropsychological Assessment Metrics in childhood‐onset systemic lupus erythematosus

Challenges of Diagnosing Cognitive Dysfunction With Neuropsychiatric Systemic Lupus Erythematosus in Childhood

Test-Retest Reliability of a Computerized Concussion Test

Contact Info

Product

Resources

About