Abstract:Introduction: Intradialytic hypotension (IDH) is prevalent and associated with high hospitalization and mortality rates. The purpose of this study was to explore the risk factors for IDH and use artificial intelligence to establish an early alert system before hemodialysis sessions to identify patients at high risk of IDH.
Materials and methods: We obtained data on 314534 hemodialysis sessions conducted at Sichuan Provincial People's Hospital from the Renal Disease Treatment Information System. IDH was defined… Show more
“…The outcomes revealed the superior performance of the original column-line graph model in the external validation, boasting an AUC value of 0.746 (95% CI: 0.718-0.775), aligning closely with the observations of Hong et al. who reported an AUC of 0.743 [ 32 ]. Nevertheless, it was discerned that the discriminative and calibration capabilities of all three initial prediction models were notably overestimated.…”
Objective
Intradialytic hypotension (IDH) is a common and serious complication in patients with Maintenance Hemodialysis (MHD). The purpose of this study is to externally verify three IDH risk prediction models recently developed by Ma et al. and recalibrate, update and present the optimal model to improve the accuracy and applicability of the model in clinical environment.
Methods
A multicenter prospective cohort study of patients from 11 hemodialysis centers in Sichuan Province, China, was conducted using convenience sampling from March 2022 to July 2022, with a follow-up period of 1 month. Model performance was assessed by: (1) Discrimination: Evaluated through the computation of the Area Under Curve (AUC) and its corresponding 95% confidence intervals. (2) Calibration: scrutinized through visual inspection of the calibration plot and utilization of the Brier score. (3) The incremental value of risk prediction and the utility of updating the model were gauged using NRI (Net Reclassification Improvement) and IDI (Integrated Discrimination Improvement). Decision Curve Analysis (DCA) was employed to evaluate the clinical benefit of updating the model.
Results
The final cohort comprised 2235 individuals undergoing maintenance hemodialysis, exhibiting a 14.6% occurrence rate of IDH. The externally validated Area Under the Curve (AUC) values for the three original prediction models were 0.746 (95% CI: 0.718 to 0.775), 0.709 (95% CI: 0.679 to 0.739), and 0.735 (95% CI: 0.706 to 0.764) respectively. Conversely, the AUC value for the recalibrated and updated columnar plot model reached 0.817 (95% CI: 0.791 to 0.842), accompanied by a Brier score of 0.081. Furthermore, Decision Curve Analysis (DCA) exhibited a net benefit within the threshold probability range of 15.2% to 87.1%.
Conclusion
Externally validated, recalibrated, updated, and presented IDH prediction models may serve as a valuable instrument for evaluating IDH risk in clinical practice. Furthermore, they hold the potential to guide clinical providers in discerning individuals at risk and facilitating judicious clinical intervention decisions.
“…The outcomes revealed the superior performance of the original column-line graph model in the external validation, boasting an AUC value of 0.746 (95% CI: 0.718-0.775), aligning closely with the observations of Hong et al. who reported an AUC of 0.743 [ 32 ]. Nevertheless, it was discerned that the discriminative and calibration capabilities of all three initial prediction models were notably overestimated.…”
Objective
Intradialytic hypotension (IDH) is a common and serious complication in patients with Maintenance Hemodialysis (MHD). The purpose of this study is to externally verify three IDH risk prediction models recently developed by Ma et al. and recalibrate, update and present the optimal model to improve the accuracy and applicability of the model in clinical environment.
Methods
A multicenter prospective cohort study of patients from 11 hemodialysis centers in Sichuan Province, China, was conducted using convenience sampling from March 2022 to July 2022, with a follow-up period of 1 month. Model performance was assessed by: (1) Discrimination: Evaluated through the computation of the Area Under Curve (AUC) and its corresponding 95% confidence intervals. (2) Calibration: scrutinized through visual inspection of the calibration plot and utilization of the Brier score. (3) The incremental value of risk prediction and the utility of updating the model were gauged using NRI (Net Reclassification Improvement) and IDI (Integrated Discrimination Improvement). Decision Curve Analysis (DCA) was employed to evaluate the clinical benefit of updating the model.
Results
The final cohort comprised 2235 individuals undergoing maintenance hemodialysis, exhibiting a 14.6% occurrence rate of IDH. The externally validated Area Under the Curve (AUC) values for the three original prediction models were 0.746 (95% CI: 0.718 to 0.775), 0.709 (95% CI: 0.679 to 0.739), and 0.735 (95% CI: 0.706 to 0.764) respectively. Conversely, the AUC value for the recalibrated and updated columnar plot model reached 0.817 (95% CI: 0.791 to 0.842), accompanied by a Brier score of 0.081. Furthermore, Decision Curve Analysis (DCA) exhibited a net benefit within the threshold probability range of 15.2% to 87.1%.
Conclusion
Externally validated, recalibrated, updated, and presented IDH prediction models may serve as a valuable instrument for evaluating IDH risk in clinical practice. Furthermore, they hold the potential to guide clinical providers in discerning individuals at risk and facilitating judicious clinical intervention decisions.
“…Particularly well-suited for tasks involving categorical and heterogeneous data [29], CatBoost emerged as the top-performing machine learning algorithm in our study across all IDH de nitions. In prior studies on machine learning-based IDH prediction, Daqing Hong et al [15] utilized 18 machine learning algorithms, with the top three being random forest (AUC = 0.812, 95% CI = 0.811-0.813), gradient boosting (AUC = 0.748, 95% CI = 0.747-0.749), and logistic regression (AUC = 0.743, 95% CI = 0.742-0.744). Notably, our study incorporated the CatBoost algorithm, which was absent in their analysis.…”
Section: Discussionmentioning
confidence: 99%
“…Secondly, the assessment of IDH in our study lacked the inclusion of clinical symptoms due to the unavailability of valid clinical symptom data. Notably, a limited number of studies incorporated clinical symptoms [15,34],…”
Section: Discussionmentioning
confidence: 99%
“…Firstly, the absence of consensus on IDH de nitions has led to variations in the de nitions employed across current research [11,12]. Secondly, the spectrum of clinical features gathered in these studies is diverse, encompassing blood test indices, medication pro les, hemodialysis-related parameters, co-morbidities, and cardiothoracic ratios, but none have incorporated echocardiography-related parameters [13][14][15][16]. However, this study highlights the potential of echocardiographic assessments as a predictive tool for IDH [17].…”
Background
Intradialytic hypotension (IDH) remains a prevalent complication of hemodialysis, which is associated with adverse outcomes for patients. This study seeks to harness machine learning to construct predictive models for IDH based on multiple definitions.
Methods
In this study, a comprehensive approach was employed, leveraging a dataset comprising 35,431 hemodialysis (HD) sessions for training and testing cohort, with an additional 15,546 HD sessions serving as an external validation cohort. Five definitions of IDH were employed, and models for each IDH definition were constructed using ten machine learning algorithms. Subsequently, model interpretation was facilitated. Feature simplification ensued, leading to the creation and evaluation of a streamlined machine learning model. Both the most effective machine learning model and its simplified counterpart underwent external validation.
Results
Across the five distinct definitions of IDH, the CatBoost model consistently demonstrated superior predictive prowess, yielding the highest ROC-AUC (Definition 1–5: 0.859, 0.864, 0.880, 0.848, 0.845). Noteworthy is the persistent inclusion of certain features within the top 20 across all definitions, including LVMI, etc. Leveraging these features, we developed robust machine learning models that exhibited commendable performance (ROC-AUC for Definition 1–5: 0.858, 0.860, 0.879, 0.847, 0.841). Both the leading original machine learning model and the refined simplified machine learning model demonstrated commendable performance on an external validation set.
Conclusions
Machine learning emerged as a reliable tool for predicting IDH in HD patients. Notably, LVMI emerged as a crucial feature for effectively predicting IDH. The simplified models are accessible on the provided website.
“…Machine learning (ML) is now widely used in the construction of clinical prediction models for specific tasks, ultimately yielding more accurate predictive models [21]. In nephrology, ML has found utility in identifying high-risk patients [22], managing transplant recipients [23], making prescribing decisions for hemodialysis patients [24], and more. Harnessing ML's potential in kidney disease enhances clinicians' ability to predict ESKD and CKD [25].…”
Background: This study aimed to develop and validate a machine learning (ML) model based on serum Klotho for predicting end-stage kidney disease (ESKD) and cardiovascular disease (CVD) in patients with chronic kidney disease (CKD).
Methods: Five different ML models were trained to predict the risk of ESKD and CVD at three different time points (3, 5, and 8-year) using a cohort of 400 non-dialysis CKD patients. The dataset was divided into a training set (70%) and an internal validation set (30%). These models were informed by data comprising 47 clinical features, including serum Klotho. The best-performing model was selected and used to identify risk factors for each outcome. Model performance was assessed using various metrics.
Results: The findings showed that the Lasso regression model had the highest accuracy (C-index=0.71) in predicting ESKD. The features mainly included in this model were estimated glomerular filtration rate (eGFR), 24-hour urinary microalbumin, serum albumin, phosphate, parathyroid hormone, and serum Klotho, which achieved the highest area under the curve (AUC) of 0.930 (95% CI: 0.897-0.962). In addition, for the CVD risk prediction, the Random Survival Forest (RSF) model with the highest accuracy (C-index=0.66) was selected and achieved the highest AUC of 0.782 (95% CI: 0.633-0.930). The features mainly included in this model were age, history of primary hypertension, calcium, tumor necrosis factor-alpha, and serum Klotho.
Conclusion: We successfully developed and validated Klotho-based ML risk prediction models for CVD and ESKD in CKD patients with good performance, indicating their high clinical utility.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.