A hybrid artificial intelligence model leverages multi-centric clinical data to improve fetal heart rate pregnancy prediction across time-lapse systems

Abstract

STUDY QUESTION Can artificial intelligence (AI) algorithms developed to assist embryologists in evaluating embryo morphokinetics be enriched with multi-centric clinical data to better predict clinical pregnancy outcome? SUMMARY ANSWER Training algorithms on multi-centric clinical data significantly increased AUC compared to algorithms that only analyzed the time-lapse system (TLS) videos. WHAT IS KNOWN ALREADY Several AI-based algorithms have been developed to predict pregnancy, most of them based only on analysis of the time-lapse recording of embryo development. It remains unclear, however, whether considering numerous clinical features can improve the predictive performances of time-lapse based embryo evaluation. STUDY DESIGN, SIZE, DURATION A dataset of 9986 embryos (95.60% known clinical pregnancy outcome, 32.47% frozen transfers) from 5226 patients from 14 European fertility centers (in two countries) recorded with three different TLS was used to train and validate the algorithms. A total of 31 clinical factors were collected. A separate test set (447 videos) was used to compare performances between embryologists and the algorithm. PARTICIPANTS/MATERIALS, SETTING, METHODS Clinical pregnancy (defined as a pregnancy leading to a fetal heartbeat) outcome was first predicted using a 3D convolutional neural network that analyzed videos of the embryonic development up to 2 or 3 days of development (33% of the database) or up to 5 or 6 days of development (67% of the database). The output video score was then fed as input alongside clinical features to a gradient boosting algorithm that generated a second score corresponding to the hybrid model. AUC was computed across 7-fold of the validation dataset for both models. These predictions were compared to those of 13 senior embryologists made on the test dataset. MAIN RESULTS AND THE ROLE OF CHANCE The average AUC of the hybrid model across all 7-fold was significantly higher than that of the video model (0.727 versus 0.684, respectively, P = 0.015; Wilcoxon test). A SHapley Additive exPlanations (SHAP) analysis of the hybrid model showed that the six first most important features to predict pregnancy were morphokinetics of the embryo (video score), oocyte age, total gonadotrophin dose intake, number of embryos generated, number of oocytes retrieved, and endometrium thickness. The hybrid model was shown to be superior to embryologists with respect to different metrics, including the balanced accuracy (P ≤ 0.003; Wilcoxon test). The likelihood of pregnancy was linearly linked to the hybrid score, with increasing odds ratio (maximum P-value = 0.001), demonstrating the ranking capacity of the model. Training individual hybrid models did not improve predictive performance. A clinic hold-out experiment was conducted and resulted in AUCs ranging between 0.63 and 0.73. Performance of the hybrid model did not vary between TLS or between subgroups of embryos transferred at different days of embryonic development. The hybrid model did fare better for patients older than 35 years (P < 0.001; Mann–Whitney test), and for fresh transfers (P < 0.001; Mann–Whitney test). LIMITATIONS, REASONS FOR CAUTION Participant centers were located in two countries, thus limiting the generalization of our conclusion to wider subpopulations of patients. Not all clinical features were available for all embryos, thus limiting the performances of the hybrid model in some instances. WIDER IMPLICATIONS OF THE FINDINGS Our study suggests that considering clinical data improves pregnancy predictive performances and that there is no need to retrain algorithms at the clinic level unless they follow strikingly different practices. This study characterizes a versatile AI algorithm with similar performance on different time-lapse microscopes and on embryos transferred at different development stages. It can also help with patients of different ages and protocols used but with varying performances, presumably because the task of predicting fetal heartbeat becomes more or less hard depending on the clinical context. This AI model can be made widely available and can help embryologists in a wide range of clinical scenarios to standardize their practices. STUDY FUNDING/COMPETING INTEREST(S) Funding for the study was provided by ImVitro with grant funding received in part from BPIFrance (Bourse French Tech Emergence (DOS0106572/00), Paris Innovation Amorçage (DOS0132841/00), and Aide au Développement DeepTech (DOS0152872/00)). A.B.-C. is a co-owner of, and holds stocks in, ImVitro SAS. A.B.-C. and F.D.M. hold a patent for ‘Devices and processes for machine learning prediction of in vitro fertilization’ (EP20305914.2). A.D., N.D., M.M.F., and F.D.M. are or have been employees of ImVitro and have been granted stock options. X.P.-V. has been paid as a consultant to ImVitro and has been granted stocks options of ImVitro. L.C.-D. and C.G.-S. have undertaken paid consultancy for ImVitro SAS. The remaining authors have no conflicts to declare. TRIAL REGISTRATION NUMBER N/A.

AI facilitated sperm detection in azoospermic samples for use in ICSI

“…CNN algorithms are a type of deep-learning model that attempts to simply replicate the human visual cortex with a simulated network of connected neuron layers (neural network) that, through iterative training, transforms input data into the desired output labels. There have been considerable studies on the utility of machine learning and AI-based image analysis on the selection of embryos for prediction of euploidy status, implantation potential and incidence of miscarriage (Barnes et al, 2023, Diakiw et al, 2022, Duval et al, 2023, Hariharan et al, 2019, Tran et al, 2018, VerMilyea et al, 2020). Studies have also proven the application of ML in the selection and assessment of sperm for use in ICSI by tacking sperm correlated with better quality blastocysts (Joshi et al, 2023, Mendizabal-Ruiz et al, 2022).…”

Embryo Transfer is the last Frontier for Deep Machine Learning & Artificial Intelligence in Medically Assisted Reproduction (MAR)

“…The main outcome measures included accuracy of the algorithm to predict four critical clinical decisions during ovarian stimulation for IVF: [1] stop stimulation or continue stimulation. If the decision was to stop, then the next automated decision was to [2] trigger or cancel. If the decision was to return, then the next key decisions were [3] number of days to follow-up and [4] whether any dosage adjustment was needed.…”

“…Indeed, it is generally acknowledged that even after embryo selection based on morphology, timelapse microscopic photography, or embryo biopsy with preimplantation genetic testing (PGT-A), implantation rates in the human are difficult to predict. Recently, several artificial intelligence (AI)-based methods have emerged as objective, standardized, and efficient tools for evaluating human embryos 1,2 . Artificial Intelligence (AI) and Machine Learning (ML) are clearly emerging technologies in Medically Assisted Reproduction (MAR) and would benefit from early application of reporting standards.…”

“…The models for ploidy prediction, however, were not highly predictive, suggesting they cannot replace preimplantation genetic testing currently 1 . New methodology, involving deep machine learning enriched with multi-centric clinical data, where every image from the time-lapse documentation is analyzed by an algorithm, looking for patterns that link to outcome, may in the future provide a more accurate and non-biased embryo selection process 2 .…”

“…MMC IVF, Dubai, UAE & Rotunda-Center for Human Reproduction, Mumbai, India 2. Rotunda-Center for Human Reproduction, Mumbai, India 3.…”