Background Accurate prediction of tumour response to neoadjuvant chemoradiotherapy enables personalised perioperative therapy for locally advanced rectal cancer. We aimed to develop and validate an artificial intelligence radiopathomics integrated model to predict pathological complete response in patients with locally advanced rectal cancer using pretreatment MRI and haematoxylin and eosin (H&E)-stained biopsy slides. MethodsIn this multicentre observational study, eligible participants who had undergone neoadjuvant chemoradiotherapy followed by radical surgery were recruited, with their pretreatment pelvic MRI (T2-weighted imaging, contrast-enhanced T1-weighted imaging, and diffusion-weighted imaging) and whole slide images of H&E-stained biopsy sections collected for annotation and feature extraction. The RAdioPathomics Integrated preDiction System (RAPIDS) was constructed by machine learning on the basis of three feature sets associated with pathological complete response: radiomics MRI features, pathomics nucleus features, and pathomics microenvironment features from a retrospective training cohort. The accuracy of RAPIDS for the prediction of pathological complete response in locally advanced rectal cancer was verified in two retrospective external validation cohorts and further validated in a multicentre, prospective observational study (ClinicalTrials.gov, NCT04271657). Model performances were evaluated using area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

Background The aim of this work is to combine radiological and pathological information of tumor to develop a signature for pretreatment prediction of discrepancies of pathological response at several centers and restage patients with locally advanced rectal cancer (LARC) for individualized treatment planning. Patients and Methods A total of 981 consecutive patients with evaluation of response according to tumor regression grade (TRG) who received nCRT were retrospectively recruited from four hospitals (primary cohort and external validation cohort 1–3); both pretreatment multiparametric MRI (mp-MRI) and whole slide image (WSI) of biopsy specimens were available for each patient. Quantitative image features were extracted from mp-MRI and WSI and used to construct a radiopathomics signature (RPS) powered by an artificial-intelligence model. Models based on mp-MRI or WSI alone were also constructed for comparison. Results The RPS showed overall accuracy of 79.66–87.66% in validation cohorts. The areas under the curve of RPS at specific response grades were 0.98 (TRG0), 0.93 (≤ TRG1), and 0.84 (≤ TRG2). RPS at each grade of pathological response revealed significant improvement compared with both signatures constructed without combining multiscale tumor information (P < 0.01). Moreover, RPS showed relevance to distinct probabilities of overall survival and disease-free survival in patients with LARC who underwent nCRT (P < 0.05). Conclusions The results of this study suggest that radiopathomics, combining both radiological information of the whole tumor and pathological information of local lesions from biopsy, could potentially predict discrepancies of pathological response prior to nCRT for better treatment planning.

Biochemical recurrence (BCR) occurs in up to 27% of patients after radical prostatectomy (RP) and often compromises oncologic survival. To determine whether imaging signatures on clinical prostate magnetic resonance imaging (MRI) could noninvasively characterize biochemical recurrence and optimize treatment. We retrospectively enrolled 485 patients underwent RP from 2010 to 2017 in three institutions. Quantitative and interpretable features were extracted from T2 delineated tumors. Deep learning-based survival analysis was then applied to develop the deep-radiomic signature (DRS-BCR). The model’s performance was further evaluated, in comparison with conventional clinical models. The model achieved C-index of 0.802 in both primary and validating cohorts, outweighed the CAPRA-S score (0.677), NCCN model (0.586) and Gleason grade group systems (0.583). With application analysis, DRS-BCR model can significantly reduce false-positive predictions, so that nearly one-third of patients could benefit from the model by avoiding overtreatments. The deep learning-based survival analysis assisted quantitative image features from MRI performed well in prediction for BCR and has significant potential in optimizing systemic neoadjuvant or adjuvant therapies for prostate cancer patients.