Evidence-based decision support for pediatric rheumatology reduces diagnostic errors

Abstract

BackgroundThe number of trained specialists world-wide is insufficient to serve all children with pediatric rheumatologic disorders, even in the countries with robust medical resources. We evaluated the potential of diagnostic decision support software (DDSS) to alleviate this shortage by assessing the ability of such software to improve the diagnostic accuracy of non-specialists.MethodsUsing vignettes of actual clinical cases, clinician testers generated a differential diagnosis before and after using diagnostic decision support software. The evaluation used the SimulConsult® DDSS tool, based on Bayesian pattern matching with temporal onset of each finding in each disease. The tool covered 5405 diseases (averaging 22 findings per disease). Rheumatology content in the database was developed using both primary references and textbooks. The frequency, timing, age of onset and age of disappearance of findings, as well as their incidence, treatability, and heritability were taken into account in order to guide diagnostic decision making. These capabilities allowed key information such as pertinent negatives and evolution over time to be used in the computations. Efficacy was measured by comparing whether the correct condition was included in the differential diagnosis generated by clinicians before using the software (“unaided”), versus after use of the DDSS (“aided”).ResultsThe 26 clinicians demonstrated a significant reduction in diagnostic errors following introduction of the software, from 28% errors while unaided to 15% using decision support (p < 0.0001). Improvement was greatest for emergency medicine physicians (p = 0.013) and clinicians in practice for less than 10 years (p = 0.012). This error reduction occurred despite the fact that testers employed an “open book” approach to generate their initial lists of potential diagnoses, spending an average of 8.6 min using printed and electronic sources of medical information before using the diagnostic software.ConclusionsThese findings suggest that decision support can reduce diagnostic errors and improve use of relevant information by generalists. Such assistance could potentially help relieve the shortage of experts in pediatric rheumatology and similarly underserved specialties by improving generalists’ ability to evaluate and diagnose patients presenting with musculoskeletal complaints.Trial registrationClinicalTrials.gov ID: NCT02205086 Electronic supplementary materialThe online version of this article (doi:10.1186/s12969-016-0127-z) contains supplementary material, which is available to authorized users.

Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review

“…AI applications have the potential to provide clinical decision support. From our review, 16 studies demonstrated that AI applications could enhance clinical decision-making capacity [ 31 - 33 , 45 - 47 , 50 , 55 , 58 , 59 , 63 , 64 , 67 , 69 , 71 , 74 , 75 ]. For example, Brennan et al [ 32 ] found that clinicians gained knowledge after interacting with MySurgery, an algorithm for preoperative risk assessments, and improved their risk assessment performance as a result.…”

Effect on diagnostic accuracy of cognitive reasoning tools for the workplace setting: systematic review and meta-analysis

“…One hundred and twelve studies did not meet our inclusion criteria. Examples of excluded studies were studies where the intervention under study was not focused on supporting cognitive processes, 35 36 studies that did not measure diagnostic accuracy or diagnostic errors [37][38][39][40] or studies that did not describe an experiment. 41 42 The remaining 29 studies were included for review and meta-analysis.…”

Experience with Integrating Diagnostic Decision Support Software with Electronic Health Records: Benefits versus Risks of Information Sharing

“…Specific next steps should include the following: (1) Making use of the shift to EHR plug-in approaches such as SMART-on-FHIR [ 8 ] to use the lessons learned in this study and define the relationships between EHRs and DDSS, (2) Making use of the plug-in nature of SMART-on-FHIR [ 8 ] to adapt the functionality in a continuous way once in use, both in functions, and in technology such as the porting being done of this DDSS from client-side Java to a non-Java architecture that runs on all computers and smartphones without needing special permissioning or installation of additional software, (3) Testing in a less specialized physician group, for example by using the recently added rheumatology support in the DDSS to help general pediatricians deal with the critical shortage of pediatric rheumatologists, [ 21 ] and (4) Testing in a randomized controlled way in which the impact on diagnostic accuracy and clinician time can be assessed.…”