The application of machine learning (ML) to the field of orthopaedic surgery is rapidly increasing, but many surgeons remain unfamiliar with the nuances of this novel technique. With this editorial, we address a fundamental topic-the differences between ML techniques and traditional statistics. By doing so, we aim to further familiarize the reader with the new opportunities available thanks to the ML approach.
Background: Several factors are associated with an increased risk of anterior cruciate ligament (ACL) reconstruction revision. However, the ability to accurately translate these factors into a quantifiable risk of revision at a patient-specific level has remained elusive. We sought to determine if machine learning analysis of the Norwegian Knee Ligament Register (NKLR) can identify the most important risk factors associated with subsequent revision of primary ACL reconstruction and develop a clinically meaningful calculator for predicting revision of primary ACL reconstruction.Methods: Machine learning analysis was performed on the NKLR data set. The primary outcome was the probability of revision ACL reconstruction within 1, 2, and/or 5 years. Data were split randomly into training sets (75%) and test sets (25%). Four machine learning models were tested: Cox Lasso, survival random forest, generalized additive model, and gradient boosted regression. Concordance and calibration were calculated for all 4 models. Results:The data set included 24,935 patients, and 4.9% underwent a revision surgical procedure during a mean follow-up (and standard deviation) of 8.1 ± 4.1 years. All 4 models were well-calibrated, with moderate concordance (0.67 to 0.69). The Cox Lasso model required only 5 variables for outcome prediction. The other models either used more variables without an appreciable improvement in accuracy or had slightly lower accuracy overall. An in-clinic calculator was developed that can estimate the risk of ACL revision (Revision Risk Calculator). This calculator can quantify risk at a patient-specific level, with a plausible range from near 0% for low-risk patients to 20% for high-risk patients at 5 years.Conclusions: Machine learning analysis of a national knee ligament registry can predict the risk of ACL reconstruction revision with moderate accuracy. This algorithm supports the creation of an in-clinic calculator for point-of-care risk stratification based on the input of only 5 variables. Similar analysis using a larger or more comprehensive data set may improve the accuracy of risk prediction, and future studies incorporating patients who have experienced failure of ACL reconstruction but have not undergone subsequent revision may better predict the true risk of ACL reconstruction failure.
The application of artificial intelligence (AI) and machine learning to the field of orthopaedic surgery is rapidly increasing. While this represents an important step in the advancement of our specialty, the concept of AI is rich with statistical jargon and techniques unfamiliar to many clinicians. This knowledge gap may limit the impact and potential of these novel techniques. We aim to narrow this gap in a way that is accessible for all orthopaedic surgeons. With this manuscript, we introduce the concept of AI and machine learning and give examples of how it can impact clinical practice and patient care. Level of evidence VI.
Purpose External validation of machine learning predictive models is achieved through evaluation of model performance on different groups of patients than were used for algorithm development. This important step is uncommonly performed, inhibiting clinical translation of newly developed models. Machine learning analysis of the Norwegian Knee Ligament Register (NKLR) recently led to the development of a tool capable of estimating the risk of anterior cruciate ligament (ACL) revision (https://swastvedt.shinyapps.io/calculator_rev/). The purpose of this study was to determine the external validity of the NKLR model by assessing algorithm performance when applied to patients from the Danish Knee Ligament Registry (DKLR). Methods The primary outcome measure of the NKLR model was probability of revision ACL reconstruction within 1, 2, and/or 5 years. For external validation, all DKLR patients with complete data for the five variables required for NKLR prediction were included. The five variables included graft choice, femur fixation device, KOOS QOL score at surgery, years from injury to surgery, and age at surgery. Predicted revision probabilities were calculated for all DKLR patients. The model performance was assessed using the same metrics as the NKLR study: concordance and calibration. Results In total, 10,922 DKLR patients were included for analysis. Average follow-up time or time-to-revision was 8.4 (± 4.3) years and overall revision rate was 6.9%. Surgical technique trends (i.e., graft choice and fixation devices) and injury characteristics (i.e., concomitant meniscus and cartilage pathology) were dissimilar between registries. The model produced similar concordance when applied to the DKLR population compared to the original NKLR test data (DKLR: 0.68; NKLR: 0.68–0.69). Calibration was poorer for the DKLR population at one and five years post primary surgery but similar to the NKLR at two years. Conclusion The NKLR machine learning algorithm demonstrated similar performance when applied to patients from the DKLR, suggesting that it is valid for application outside of the initial patient population. This represents the first machine learning model for predicting revision ACL reconstruction that has been externally validated. Clinicians can use this in-clinic calculator to estimate revision risk at a patient specific level when discussing outcome expectations pre-operatively. While encouraging, it should be noted that the performance of the model on patients undergoing ACL reconstruction outside of Scandinavia remains unknown. Level of evidence III.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.