Background Timely diagnosis and treatment are essential in the effective management of inflammatory rheumatic diseases (IRDs). Symptom checkers (SCs) promise to accelerate diagnosis, reduce misdiagnoses, and guide patients more effectively through the health care system. Although SCs are increasingly used, there exists little supporting evidence. Objective To assess the diagnostic accuracy, patient-perceived usability, and acceptance of two SCs: (1) Ada and (2) Rheport. Methods Patients newly presenting to a German secondary rheumatology outpatient clinic were randomly assigned in a 1:1 ratio to complete Ada or Rheport and consecutively the respective other SCs in a prospective non-blinded controlled randomized crossover trial. The primary outcome was the accuracy of the SCs regarding the diagnosis of an IRD compared to the physicians’ diagnosis as the gold standard. The secondary outcomes were patient-perceived usability, acceptance, and time to complete the SC. Results In this interim analysis, the first 164 patients who completed the study were analyzed. 32.9% (54/164) of the study subjects were diagnosed with an IRD. Rheport showed a sensitivity of 53.7% and a specificity of 51.8% for IRDs. Ada’s top 1 (D1) and top 5 disease suggestions (D5) showed a sensitivity of 42.6% and 53.7% and a specificity of 63.6% and 54.5% concerning IRDs, respectively. The correct diagnosis of the IRD patients was within the Ada D1 and D5 suggestions in 16.7% (9/54) and 25.9% (14/54), respectively. The median System Usability Scale (SUS) score of Ada and Rheport was 75.0/100 and 77.5/100, respectively. The median completion time for both Ada and Rheport was 7.0 and 8.5 min, respectively. Sixty-four percent and 67.1% would recommend using Ada and Rheport to friends and other patients, respectively. Conclusions While SCs are well accepted among patients, their diagnostic accuracy is limited to date. Trial registration DRKS.de, DRKS00017642. Registered on 23 July 2019
Background Financial codes are often used to extract diagnoses from electronic health records. This approach is prone to false positives. Alternatively, queries are constructed, but these are highly center and language specific. A tantalizing alternative is the automatic identification of patients by employing machine learning on format-free text entries. Objective The aim of this study was to develop an easily implementable workflow that builds a machine learning algorithm capable of accurately identifying patients with rheumatoid arthritis from format-free text fields in electronic health records. Methods Two electronic health record data sets were employed: Leiden (n=3000) and Erlangen (n=4771). Using a portion of the Leiden data (n=2000), we compared 6 different machine learning methods and a naïve word-matching algorithm using 10-fold cross-validation. Performances were compared using the area under the receiver operating characteristic curve (AUROC) and the area under the precision recall curve (AUPRC), and F1 score was used as the primary criterion for selecting the best method to build a classifying algorithm. We selected the optimal threshold of positive predictive value for case identification based on the output of the best method in the training data. This validation workflow was subsequently applied to a portion of the Erlangen data (n=4293). For testing, the best performing methods were applied to remaining data (Leiden n=1000; Erlangen n=478) for an unbiased evaluation. Results For the Leiden data set, the word-matching algorithm demonstrated mixed performance (AUROC 0.90; AUPRC 0.33; F1 score 0.55), and 4 methods significantly outperformed word-matching, with support vector machines performing best (AUROC 0.98; AUPRC 0.88; F1 score 0.83). Applying this support vector machine classifier to the test data resulted in a similarly high performance (F1 score 0.81; positive predictive value [PPV] 0.94), and with this method, we could identify 2873 patients with rheumatoid arthritis in less than 7 seconds out of the complete collection of 23,300 patients in the Leiden electronic health record system. For the Erlangen data set, gradient boosting performed best (AUROC 0.94; AUPRC 0.85; F1 score 0.82) in the training set, and applied to the test data, resulted once again in good results (F1 score 0.67; PPV 0.97). Conclusions We demonstrate that machine learning methods can extract the records of patients with rheumatoid arthritis from electronic health record data with high precision, allowing research on very large populations for limited costs. Our approach is language and center independent and could be applied to any type of diagnosis. We have developed our pipeline into a universally applicable and easy-to-implement workflow to equip centers with their own high-performing algorithm. This allows the creation of observational studies of unprecedented size covering different countries for low cost from already available data in electronic health record systems.
Objectives To address whether the use of methotrexate (MTX) and biological disease-modifying anti-rheumatic drugs (bDMARDs) impacts bone structure and biomechanical properties in patients with psoriatic arthritis (PsA). Methods This is a cross-sectional study in PsA patients receiving no DMARDs, MTX, or bDMARDs. Volumetric bone mineral densities (vBMDs), microstructural parameters, and biomechanical properties (stiffness/failure load) were determined by high-resolution peripheral quantitative CT and micro-finite element analysis in the respective groups. Bone parameters were compared between PsA patients with no DMARDs and those receiving any DMARDs, MTX, or bDMARDs, respectively. Results One hundred sixty-five PsA patients were analyzed, 79 received no DMARDs, 86 received DMARDs, of them 52 bDMARDs (TNF, IL-17- or IL-12/23 inhibitors) and 34 MTX. Groups were balanced for age, sex, comorbidities, functional index, and bone-active therapy, while disease duration was longest in the bDMARD group (7.8 ± 7.4 years), followed by the MTX group (4.6 ± 7.4) and the no-DMARD group (2.9 ± 5.2). No difference in bone parameters was found between the no-DMARD group and the MTX group. In contrast, the bDMARD group revealed significantly higher total ( p = 0.001) and trabecular vBMD ( p = 0.005) as well as failure load ( p = 0.012) and stiffness ( p = 0.012). In regression models, age and bDMARDs influenced total vBMD, while age, sex, and bDMARDs influenced failure load and stiffness. Conclusion Despite longer disease duration, bDMARD-treated PsA patients benefit from higher bone mass and better bone strength than PsA patients receiving MTX or no DMARDs. These data support the concept of better control of PsA-related bone disease by bDMARDs. Electronic supplementary material The online version of this article (10.1186/s13075-019-1938-3) contains supplementary material, which is available to authorized users.
The impact of primary hand osteoarthritis (HOA) on bone mass, microstructure, and biomechanics in the affected skeletal regions is largely unknown. HOA patients and healthy controls (HCs) underwent high‐resolution peripheral quantitative computed tomography (HR‐pQCT). We measured total, trabecular, and cortical volumetric bone mineral densities (vBMDs), microstructural attributes, and performed micro–finite element analysis for bone strength. Failure load and scaled multivariate outcome matrices from distal radius and second metacarpal (MCP2) head measurements were analyzed using multiple linear regression adjusting for age, sex, and functional status and reported as adjusted Z‐score differences for total and direct effects. A total of 105 subjects were included (76 HC: 46 women, 30 men; 29 HOA: 23 women, six men). After adjustment, HOA was associated with significant changes in the multivariate outcome matrix from the MCP2 head (p < .001) (explained by an increase in cortical vBMD (Δz = 1.07, p = .02) and reduction in the trabecular vBMD (Δz = −0.07, p = .09). Distal radius analysis did not show an overall effect of HOA; however, there was a gender‐study group interaction (p = .044) explained by reduced trabecular vBMD in males (Δz = −1.23, p = .02). HOA was associated with lower failure load (−514 N; 95%CI, −1018 to −9; p = 0.05) apparent in males after adjustment for functional status. HOA is associated with reduced trabecular and increased cortical vBMD in the MCP2 head and a reduction in radial trabecular vBMD and bone strength in males. Further investigations of gender‐specific changes of bone architecture in HOA are warranted. © 2020 The Authors. Journal of Bone and Mineral Research published by American Society for Bone and Mineral Research.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.