Estimates of premorbid ability in a neurodegenerative disease clinic population: comparing the Test of Premorbid Functioning and the Wide Range Achievement Test, 4th Edition

Berg, J. E.; Durant, January; Banks, Sarah J.; Miller, Justin B.

doi:10.1080/13854046.2016.1186224

Cited by 23 publications

(23 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Agreement or comparability is frequently discussed but rarely systematically examined in the neuropsychological literature. Although the methods used in this study are common in other fields, only a handful of studies in the neuropsychological literature have made use of these methods to assess agreement between scores on a continuous scale (e.g., Berg, Durant, Banks, & Miller, 2016). The current practice is to rely on estimates of linear agreement (e.g., Pearson’s correlations) which fail to capture constant differences, or mean differences (e.g., t -tests), which capture constant differences but not random or proportional differences, as large measurement error will result in the incorrect conclusion that the methods are equivalent.…”

Section: Resultsmentioning

confidence: 99%

Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

Scott

Sorrell

Benitez

2019

J Int Neuropsychol Soc

View full text Add to dashboard Cite

Objective: Few independent studies have examined the psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) in older adults, despite growing interest its use for clinical purposes. In this paper we report the test-retest reliability and construct validity of the NIHTB-CB, as well as its agreement or concordance with traditional neuropsychological tests of the same construct to determine whether tests could be used interchangeably. Methods: Sixty-one cognitively healthy adults ages 60-80 completed “gold standard” (GS) neuropsychological tests, NIHTB-CB, and brain MRI. Test-retest reliability, convergent/discriminant validity and agreement statistics were calculated using Pearson’s correlations, concordance correlation coefficients (CCC), and root mean square deviations. Results: Test-retest reliability was acceptable (CCC = .73 Fluid; CCC = .85 Crystallized). The NIHTB-CB Fluid Composite correlated significantly with cerebral volumes (r’s = ∣.35-.41∣), and both composites correlated highly with their respective GS composites (r’s = .58-.84), although this was more variable for individual tests. Absolute agreement was generally lower (CCC = .55 Fluid; CCC = .70 Crystallized) due to lower precision in Fluid scores and systematic overestimation of Crystallized Composite scores on the NIHTB-CB. Conclusions: These results support the reliability and validity of the NIHTB-CB in healthy older adults and suggest that the Fluid Composite tests are at least as sensitive as standard neuropsychological tests to medial temporal atrophy and ventricular expansion. However, the NIHTB-CB may generate different estimates of performance and should not be treated as interchangeable with established neuropsychological tests.

show abstract

Section: Resultsmentioning

confidence: 99%

Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

Scott

Sorrell

Benitez

2019

J Int Neuropsychol Soc

View full text Add to dashboard Cite

show abstract

“…In contrast to an absolute definition of agreement (i.e., Y = X), a consistency definition measures the degree of additivity, or how well a measure can be equated from another (i.e., Y = X + a ), between scales and ignores differences in the means (Schuck, 2004). The CCC is preferred over the Pearson correlation coefficient when examining the rate of agreement between two measures (Barchard, 2012; King & Chinchilli, 2001; Lin, 1989; Berg et al, 2016). The Pearson correlation coefficient demonstrates whether there is a linear relationship between measures but unlike the CCC, the Pearson correlation coefficient does not take into account differences in means and standard deviations.…”

Section: Methodsmentioning

confidence: 99%

Comparing the test of practical judgment with the neuropsychological assessment battery judgment subtest in a neurodegenerative disease clinic population

Durant

Berg

Banks

et al. 2017

Applied Neuropsychology: Adult

Self Cite

View full text Add to dashboard Cite

The Test of Practical Judgment (TOP-J) and the Judgment subtest from the Neuropsychological Assessment Battery (NAB-JDG) are both brief interview-based measures that assess judgment. This study compared estimates of judgment obtained from these measures in a neurodegenerative disease population. Records from 61 referrals seen for neuropsychological evaluation in a neurodegenerative disorders clinic were reviewed. Measures of interest included the TOP-J and NAB-JDG. Concordance correlation coefficients (CCC) and root mean square differences (RMSD) were calculated between judgment T-scores. Discrepancy scores were calculated by subtracting NAB-JDG scores from TOP-J scores. CCC showed poor agreement between the judgment measures, with evidence of fixed bias, such that the NAB-JDG systematically generates higher scores than the TOP-J. This fixed bias was present whether NAB-JDG scores are demographically adjusted or unadjusted. There was no evidence of proportional bias. In a neurodegenerative disease clinic population, the TOP-J and NAB-JDG provide estimates of judgment ability that are systematically different. These two measures may be assessing different aspects within the larger construct of judgment and the inconsistency between measures would contraindicate using them interchangeably. Clinicians will need to carefully consider patient characteristics, clinical needs, and review specific item content when selecting between these measures.

show abstract

“…The Alcohol Use Disorders Identification Test (AUDIT) [26] and the alcohol, smoking and substance involvement screening test (ASSIST) [27] are used to screen for substance use history. The Test of Premorbid Functioning (TOPF) [28] is given to assess pre-TBI intelligence. Cognitive executive function measures are gathered using the ANAM (Matching-to-sample Test, Mathematical Processing Test, Code Substitution Test, Stroop test, and Tower Puzzle) along with the Trail Making Tests (part A and B) and the Similar Situations Task.…”

Section: Methodsmentioning

confidence: 99%

Executive function training in chronic traumatic brain injury patients: study protocol

Krawczyk

Han

Martínez

et al. 2019

Trials

View full text Add to dashboard Cite

Background Some individuals who sustain traumatic brain injuries (TBIs) continue to experience significant cognitive impairments chronically (months to years post injury). Many tests of executive function are insensitive to these executive function impairments, as such impairments may only appear during complex daily life conditions. Daily life often requires us to divide our attention and focus on abstract goals. In the current study, we compare the effects of two 1-month electronic cognitive rehabilitation programs for individuals with chronic TBI. The active program (Expedition: Strategic Advantage) focuses on improving goal-directed executive functions including working memory, planning, long-term memory, and inhibitory control by challenging participants to accomplish life-like cognitive simulations. The challenge level of the simulations increases in accordance with participant achievement. The control intervention (Expedition: Informational Advantage) is identical to the active program; however, the cognitive demand level is capped, preventing participants from advancing beyond a set level. We will evaluate these interventions with a military veteran TBI population. Methods/design One hundred individuals will be enrolled in this double-blinded clinical trial (all participants and testers are blinded to condition). Each individual will be randomly assigned to one of two interventions. The primary anticipated outcomes are improvement of daily life cognitive function skills and daily life functions. These are measured by a daily life performance task, which tests cognitive skills, and a survey that evaluates daily life functions. Secondary outcomes are also predicted to include improvements in working memory, attention, planning, and inhibitory control as measured by a neuropsychological test battery. Lastly, neuroimaging measures will be used to evaluate changes in brain networks supporting cognition pre and post intervention. Discussion We will test whether electronically delivered cognitive rehabilitation aimed at improving daily life functional skills will provide cognitive and daily life functional improvements for individuals in the chronic phase of TBI recovery (greater than 3 months post injury). We aim to better understand the cognitive processes involved in recovery and the characteristics of individuals most likely to benefit. This study will also address the potential to observe generalizability or to transfer from a software-based cognitive training tool toward daily life improvement. Trial registration ClinicalTrials.gov, NCT03704116 . Retrospectively registered on 12 Oct 2018.

show abstract

Estimates of premorbid ability in a neurodegenerative disease clinic population: comparing the Test of Premorbid Functioning and the Wide Range Achievement Test, 4th Edition

Abstract: Estimates of premorbid intelligence obtained from the TOPF and WRAT-4 READ have a strong linear relationship, but systematically generate inconsistent estimates in a neurodegenerative disease clinical sample and should not be used interchangeably.

Cited by 23 publications

References 11 publications

Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

Comparing the test of practical judgment with the neuropsychological assessment battery judgment subtest in a neurodegenerative disease clinic population

Executive function training in chronic traumatic brain injury patients: study protocol

Contact Info

Product

Resources

About