Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review

Wilmoth, Kristin; Brett, Benjamin L.; Emmert, Natalie; Cook, Carolyn M.; Schaffert, Jeff; Caze, Todd; Kotsonis, Thomas; Cusick, Margaret; Solomon, Gary S.; Resch, Jacob E.; Cullum, C. Munro; Nelson, Lindsay D.; McCrea, Michael

doi:10.1007/s11065-022-09553-4

Cited by 5 publications

(3 citation statements)

References 142 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, this filtering could potentially reduce the possibility of overfitting and over predicting in both the EFA and CFA models. Finally, we note that the self-report trait-like metrics of cognition that we did retain may have more test-retest reliability than computerized neurocognitive performance measures [42], where, for example, self-report versus laboratory task-derived metrics of impulsivity typically correlate poorly within-subject [43].…”

Section: Discussionmentioning

confidence: 97%

Initial Validation of a Behavioral Phenotyping Model for Substance Use Disorder

Keyser-Marcus,

Ramey,

Bjork

et al. 2023

IJERPH

View full text Add to dashboard Cite

Standard nosological systems, such as DSM-5 or ICD-10, are relied upon as the diagnostic basis when developing treatments for individuals with substance use disorder (SUD). Unfortunately, the vast heterogeneity of individuals within a given SUD diagnosis results in a variable treatment response and/or difficulties ascertaining the efficacy signal in clinical trials of drug development. Emerging precision medicine methods focusing on targeted treatments based on phenotypic subtypes rather than diagnosis are being explored as alternatives. The goal of the present study was to provide initial validation of emergent subtypes identified by an addiction-focused phenotyping battery. Secondary data collected as part of a feasibility study of the NIDA phenotyping battery were utilized. Participants completed self-report measures and behavioral tasks across six neurofunctional domains. Exploratory and confirmatory factor analysis (EFA/CFA) were conducted. A three-factor model consisting of negative emotionality, attention/concentration, and interoception and mindfulness, as well as a four-factor model adding a second negative emotion domain, emerged from the EFA as candidate models. The CFA of these models did not result in a good fit, possibly resulting from small sample sizes that hindered statistical power.

show abstract

Section: Discussionmentioning

confidence: 97%

Initial Validation of a Behavioral Phenotyping Model for Substance Use Disorder

Keyser-Marcus,

Ramey,

Bjork

et al. 2023

IJERPH

View full text Add to dashboard Cite

show abstract

“…Moreover, access to manual NPAs is limited by a shortage of licensed clinicians to administer, score, and interpret test results. Computerized NPAs can address these shortcomings ( Wild et al, 2008 ; Cole et al, 2018 ; Rao, 2018 ; Bilder and Reise, 2019 ; Sternin et al, 2019 ; Tsoy et al, 2021 ; Ashford et al, 2022 ; Jutten et al, 2022 ; Libon et al, 2022 ; Tavabi et al, 2022 ; Wilmoth et al, 2022 ). However, with rare exceptions ( Mackin et al, 2022 ), existing computerized NPAs do not incorporate verbal tests which constitute the majority of manually administered cognitive tests ( Rabin et al, 2016 ).…”

Section: Introductionmentioning

confidence: 99%

The California Cognitive Assessment Battery (CCAB)

Woods,

Pebler,

Johnson

et al. 2024

Front. Hum. Neurosci.

View full text Add to dashboard Cite

IntroductionWe are developing the California Cognitive Assessment Battery (CCAB) to provide neuropsychological assessments to patients who lack test access due to cost, capacity, mobility, and transportation barriers.MethodsThe CCAB consists of 15 non-verbal and 17 verbal subtests normed for telemedical assessment. The CCAB runs on calibrated tablet computers over cellular or Wi-Fi connections either in a laboratory or in participants’ homes. Spoken instructions and verbal stimuli are delivered through headphones using naturalistic text-to-speech voices. Verbal responses are scored in real time and recorded and transcribed offline using consensus automatic speech recognition which combines the transcripts from seven commercial ASR engines to produce timestamped transcripts more accurate than those of any single ASR engine. The CCAB is designed for supervised self-administration using a web-browser application, the Examiner. The Examiner permits examiners to record observations, view subtest performance in real time, initiate video chats, and correct potential error conditions (e.g., training and performance failures, etc.,) for multiple participants concurrently.ResultsHere we describe (1) CCAB usability with older (ages 50 to 89) participants; (2) CCAB psychometric properties based on normative data from 415 older participants; (3) Comparisons of the results of at-home vs. in-lab CCAB testing; (4) We also present preliminary analyses of the effects of COVID-19 infection on performance. Mean z-scores averaged over CCAB subtests showed impaired performance of COVID+ compared to COVID- participants after factoring out the contributions of Age, Education, and Gender (AEG). However, inter-cohort differences were no longer significant when performance was analyzed with a comprehensive model that factored out the influences of additional pre-existing demographic factors that distinguished COVID+ and COVID- cohorts (e.g., vocabulary, depression, race, etc.,). In contrast, unlike AEG scores, comprehensive scores correlated significantly with the severity of COVID infection. (5) Finally, we found that scoring models influenced the classification of individual participants with Mild Cognitive Impairment (MCI, z-scores < –1.50) where the comprehensive model accounted for more than twice as much variance as the AEG model and reduced racial bias in MCI classification.DiscussionThe CCAB holds the promise of providing scalable laboratory-quality neurodiagnostic assessments to underserved urban, exurban, and rural populations.

show abstract

“…In youth athletes, NBT may be of limited value owing to neurocognitive development and poor discriminative ability beyond the initial (i.e., post-24-h) period following a concussion (4,5). Moreover, NBT demonstrates low test re-test reliability (24)(25)(26)(27); this is particularly problematic in youth sports where cognitive development is dynamic (4,5). Natural variability in cognitive abilities due to personal and contextual factors (e.g., academic stress) and purposefully underperforming (i.e., "sandbagging") on baseline testing also compromises the validity of baseline testing (28)(29)(30).…”

mentioning

confidence: 99%

Navigating uncertainty: exploring parents' knowledge of concussion management and neuropsychological baseline testing

Hagopian,

Jorgensen,

Lehmann

et al. 2024

Front. Sports Act. Living

View full text Add to dashboard Cite

IntroductionParents play an important role in preventing and managing sport-related concussions among youth sport participants. Research indicates that parents understand the severity and consequences associated with the injury but gaps exist in their knowledge of its management. Neuropsychological baseline testing (NBT) is a modality that has gained interest in youth sport to purportedly better manage concussion injuries. Little is known about parents' perspectives on the use of NBT in the management process.MethodsThe present qualitative study used Protection Motivation Theory as a guiding framework and employed focus groups (N = 2) with parents (N = 11) to gain insight into parents' perceptions and experiences with concussion management, specifically focusing on NBT.ResultsInductive Content Analysis developed a core theme of navigating uncertainty. Participants expressed uncertainty about the nature of concussion and its management process, where concussion was not always easy to identify, youth were not always reliable reporters, and there was no prescribed or proscribed path for recovery. Personal experience and concussion management policy provided participants with a degree of certainty in managing concussions. Participants gave NBT mixed reviews in potentially promoting greater certainty but also held reservations about its usefulness in concussion management.DiscussionWe discuss findings relative to existing knowledge and theory in youth sport concussion and identify implications for practice.

show abstract

Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review

Cited by 5 publications

References 142 publications

Initial Validation of a Behavioral Phenotyping Model for Substance Use Disorder

Initial Validation of a Behavioral Phenotyping Model for Substance Use Disorder

The California Cognitive Assessment Battery (CCAB)

Navigating uncertainty: exploring parents' knowledge of concussion management and neuropsychological baseline testing

Contact Info

Product

Resources

About