A Novel Digital Digit-Symbol Substitution Test Measuring Processing Speed in Adults At Risk for Alzheimer Disease: Validation Study

Abstract

Background Assessing cognitive constructs affected by Alzheimer disease, such as processing speed (PS), is important to screen for potential disease and allow for early detection. Digital PS assessments have been developed to provide widespread, efficient cognitive testing, but all have been validated only based on the correlation between test scores. Best statistical practices dictate that concurrent validity should be assessed for agreement or equivalence rather than using correlation alone. Objective This study aimed to assess the concurrent validity of a novel digital PS assessment against a gold-standard measure of PS. Methods Adults aged 45-75 years (n=191) participated in this study. Participants completed the novel digital digit-symbol substitution test (DDSST) and the Repeatable Battery for the Assessment of Neuropsychological Status coding test (RBANS-C). The correlation between the test scores was determined using a Pearson product-moment correlation, and a difference in mean test scores between tests was checked for using a 2-tailed dependent samples t test. Data were analyzed for agreement between the 2 tests using Bland-Altman limits of agreement and equivalency using a two one-sided t tests (TOST) approach. Results A significant moderate, positive correlation was found between DDSST and RBANS-C scores (r=.577; P<.001), and no difference in mean scores was detected between the tests (P=.93). Bias was nearly zero (0.04). Scores between the tests were found to display adequate agreement with 90% of score differences falling between –22.66 and 22.75 (90% limits of agreement=–22.91 to 22.99), and the scores were equivalent (P=.049). Conclusions Analyses indicate that the DDSST is a valid digital assessment of PS. The DDSST appears to be a suitable option for widespread, immediate, and efficient PS testing. Trial Registration ClinicalTrials.gov NCT04559789; https://clinicaltrials.gov/ct2/show/NCT04559789

Macroscale neurovascular coupling and functional integration in end‐stage renal disease patients with cognitive impairment: A multimodal MRI study

“…Digit span tasks, including forward and backward digit span tasks (FDST and BDST), were used to assess working memory and attention (Warden et al., 2016). Digital symbol substitution test (DSST) was used to assess motor speed, attention, and visuo‐perceptual functions (Campitelli et al., 2023; Jaeger, 2018). Hamilton anxiety scale (HAMA) and Hamilton depression scale (HAMD) were used to examine depressive and anxiety mood states (Vaccarino et al., 2008).…”

The efficacy and practicality of the Neurotrack Cognitive Battery assessment for utilization in clinical settings for the identification of cognitive decline in an older Japanese population

“…Symbol Match is a validated 2-min assessment of processing speed and executive function (Kiely et al, 2014 ; Fellows and Schmitter-Edgecombe, 2020 ; Campitelli et al, 2023 ), with good test–retest reliability ( r = 0.72, p < 0.001) (Myers et al, 2022 ). Participants are shown a legend with nine symbol/digit pairs; the first five pairs use numbers 1 through 5, and the last four pairs repeat numbers 1 to 5 ( Figure 1 ).…”

Digital 2-year multidomain health interventions improve cognition and stabilize Alzheimer’s disease risk in at-risk adults (DC-MARVEL): A randomized controlled trial

“…For all measured domains aside from executive function and task-inhibition, higher scores indicate better performance. The NCB is a valid and reliable assessment of neuropsychological status [32][33][34][35][36][37] with excellent ability to discriminate individuals with likely cognitive impairment from healthy controls 33,37 .…”