Impact of a clinical decision support tool on prediction of progression in early-stage dementia: a prospective validation study

Abstract

BackgroundIn clinical practice, it is often difficult to predict which patients with cognitive complaints or impairment will progress or remain stable. We assessed the impact of using a clinical decision support system, the PredictND tool, to predict progression in patients with subjective cognitive decline (SCD) and mild cognitive impairment (MCI) in memory clinics.MethodsIn this prospective multicenter study, we included 429 patients with SCD (n = 230) and MCI (n = 199) (female 54%, age 67 ± 9, MMSE 28 ± 2) and followed them for at least 12 months. Based on all available patient baseline data (demographics, cognitive tests, cerebrospinal fluid biomarkers, and MRI), the PredictND tool provides a comprehensive overview of the data and a classification defining the likelihood of progression. At baseline, a clinician defined an expected follow-up diagnosis and estimated the level of confidence in their prediction using a visual analogue scale (VAS, 0–100%), first without and subsequently with the PredictND tool. As outcome measure, we defined clinical progression as progression from SCD to MCI or dementia, and from MCI to dementia. Correspondence between the expected and the actual clinical progression at follow-up defined the prognostic accuracy.ResultsAfter a mean follow-up time of 1.7 ± 0.4 years, 21 (9%) SCD and 63 (32%) MCI had progressed. When using the PredictND tool, the overall prognostic accuracy was unaffected (0.4%, 95%CI − 3.0%; + 3.9%; p = 0.79). However, restricting the analysis to patients with more certain classifications (n = 203), we found an increase of 3% in the accuracy (95%CI − 0.6%; + 6.5%; p = 0.11). Furthermore, for this subgroup, the tool alone showed a statistically significant increase in the prognostic accuracy compared to the evaluation without tool (6.4%, 95%CI 2.1%; 10.7%; p = 0.004). Specifically, the negative predictive value was high. Moreover, confidence in the prediction increased significantly (∆VAS = 4%, p < .0001).ConclusionsAdding the PredictND tool to the clinical evaluation increased clinicians’ confidence. Furthermore, the results indicate that the tool has the potential to improve prediction of progression for patients with more certain classifications.Electronic supplementary materialThe online version of this article (10.1186/s13195-019-0482-3) contains supplementary material, which is available to authorized users.

Use of a Decision Support Tool on Prognosis of Work Ability in Work Disability Assessments: An Experimental Study Among Insurance Physicians

“…This low efficacy can possibly be explained by the low initial agreement between IPs’ prognosis and the outcome of the decision support tool, which could have influenced IPs’ trust in the tool. Although the percentage of changed prognoses in our study was rather low, this is in line with results from a study on the impact of a decision support tool on prediction of progression in early-stage dementia [ 30 ]. This prospective multicenter study including 429 patients showed that clinicians changed the prediction of progression only in 13% patients after using the tool.…”

cCOG: A web‐based cognitive test tool for detecting neurodegenerative disorders

“…The PredictND (Predict Neurodegenerative Disorders) cohort (PredictND) included patients with MMSE ≥ 25 and contained data from 323 cognitively normal, MCI, and dementia patients from four European memory clinics. The data were acquired during 2015 to 2016 18,19 …”

Cognitively supernormal older adults maintain a unique structural connectome that is resistant to Alzheimer’s pathology

“…There is a need for identifying biomarkers for early detection of AD that can simultaneously predict cognitive trajectories and various AD pathologies, and are specific for AD. Existing predictors based on multi-dimensional data at baseline ( Bruun et al, 2019 , Rhodius-Meester et al, 2018 ) are typically focused on clinical progression of dementia and seem to be limited in linking the cognitive and pathological aspects of AD ( Giorgio et al 2020 ). Although an association has been demonstrated between tau and cognitive impairment ( Bejanin et al, 2017 , Riley et al, 2002 ), studies have largely been correlational and have not fully characterized this connection.…”