Intraoperative diagnosis is essential for providing safe and effective care during cancer surgery 1. The existing workflow for intraoperative diagnosis based on hematoxylin and eosin-staining of processed tissue is time-, resource-, and labor-intensive 2,3. Moreover, interpretation of intraoperative histologic images is dependent on a contracting, unevenly distributed pathology workforce 4. Here, we report a parallel workflow that combines stimulated Raman histology (SRH) 5-7 , a label-free optical imaging method, and deep convolutional neural networks (CNN) to predict diagnosis at the bedside in near real-time in an automated fashion. Specifically, our CNN, trained on over 2.5 million SRH images, predicts brain tumor diagnosis in the operating room in under 150 seconds, an order of magnitude faster than conventional techniques (e.g., 20-30 minutes) 2. In a multicenter, prospective clinical trial (n = 278) we demonstrated that CNN-based diagnosis of SRH images was non-inferior to pathologist-based interpretation of conventional histologic images (overall accuracy, 94.6% vs. 93.9%). Our CNN learned a hierarchy of recognizable histologic feature representations to classify the major histopathologic classes of brain tumors. Additionally, we implemented a semantic segmentation method to identify tumor infiltrated, diagnostic regions within SRH images. These results demonstrate how intraoperative cancer diagnosis can be streamlined, creating a complimentary pathway for tissue diagnosis that is independent of a traditional pathology laboratory.

OBJECTIVEPituitary adenomas occur in a heterogeneous patient population with diverse perioperative risk factors, endocrinopathies, and other tumor-related comorbidities. This heterogeneity makes predicting postoperative outcomes challenging when using traditional scoring systems. Modern machine learning algorithms can automatically identify the most predictive risk factors and learn complex risk-factor interactions using training data to build a robust predictive model that can generalize to new patient cohorts. The authors sought to build a predictive model using supervised machine learning to accurately predict early outcomes of pituitary adenoma surgery.METHODSA retrospective cohort of 400 consecutive pituitary adenoma patients was used. Patient variables/predictive features were limited to common patient characteristics to improve model implementation. Univariate and multivariate odds ratio analysis was performed to identify individual risk factors for common postoperative complications and to compare risk factors with model predictors. The study population was split into 300 training/validation patients and 100 testing patients to train and evaluate four machine learning models using binary classification accuracy for predicting early outcomes.RESULTSThe study included a total of 400 patients. The mean ± SD patient age was 53.9 ± 16.3 years, 59.8% of patients had nonfunctioning adenomas and 84.7% had macroadenomas, and the mean body mass index (BMI) was 32.6 ± 7.8 (58.0% obesity rate). Multivariate odds ratio analysis demonstrated that age < 40 years was associated with a 2.86 greater odds of postoperative diabetes insipidus and that nonobese patients (BMI < 30) were 2.2 times more likely to develop postoperative hyponatremia. Using broad criteria for a poor early postoperative outcome—major medical and early surgical complications, extended length of stay, emergency department admission, inpatient readmission, and death—31.0% of patients met criteria for a poor early outcome. After model training, a logistic regression model with elastic net (LR-EN) regularization best predicted early postoperative outcomes of pituitary adenoma surgery on the 100-patient testing set—sensitivity 68.0%, specificity 93.3%, overall accuracy 87.0%. The receiver operating characteristic and precision-recall curves for the LR-EN model had areas under the curve of 82.7 and 69.5, respectively. The most important predictive variables were lowest perioperative sodium, age, BMI, highest perioperative sodium, and Cushing’s disease.CONCLUSIONSEarly postoperative outcomes of pituitary adenoma surgery can be predicted with 87% accuracy using a machine learning approach. These results provide insight into how predictive modeling using machine learning can be used to improve the perioperative management of pituitary adenoma patients.

Background Detection of glioma recurrence remains a challenge in modern neuro-oncology. Noninvasive radiographic imaging is unable to definitively differentiate true recurrence versus pseudoprogression. Even in biopsied tissue, it can be challenging to differentiate recurrent tumor and treatment effect. We hypothesized that intraoperative stimulated Raman histology (SRH) and deep neural networks can be used to improve the intraoperative detection of glioma recurrence. Methods We used fiber-laser-based SRH, a label-free, non-consumptive, high-resolution microscopy method (&lt;60 secs per 1 x 1 mm2) to image a cohort of patients (n = 35) with suspected recurrent gliomas who underwent biopsy or resection. The SRH images were then used to train a convolutional neural network (CNN) and develop an inference algorithm to detect viable recurrent glioma. Following network training, the performance of the CNN was tested for diagnostic accuracy in a retrospective cohort (n = 48). Results Using patch-level CNN predictions, the inference algorithm returned a single Bernoulli distribution for the probability of tumor recurrence for each surgical specimen or patient. The external SRH validation dataset consisted of 48 patients (recurrent, 30; pseudoprogression, 18), and we achieved a diagnostic accuracy of 95.8%. Conclusion SRH with CNN-based diagnosis can be used to improve the intraoperative detection of glioma recurrence in near-real time. Our results provide insight into how optical imaging and computer vision can be combined to augment conventional diagnostic methods and improve the quality of specimen sampling at glioma recurrence.

The discovery of a new mass involving the brain or spine typically prompts referral to a neurosurgeon to consider biopsy or surgical resection. Intraoperative decision-making depends significantly on the histologic diagnosis, which is often established when a small specimen is sent for immediate interpretation by a neuropathologist. Access to neuropathologists may be limited in resource-poor settings, which has prompted several groups to develop machine learning algorithms for automated interpretation. Most attempts have focused on fixed histopathology specimens, which do not apply in the intraoperative setting. The greatest potential for clinical impact probably lies in the automated diagnosis of intraoperative specimens. Successful future studies may use machine learning to automatically classify whole-slide intraoperative specimens among a wide array of potential diagnoses.

We recently developed and validated a bedside tissue-to-diagnosis pipeline using stimulated Raman histology (SRH), a label-free optical imaging method, and deep convolutional neural networks (CNN) in prospective clinical trial. Our CNN learned a hierarchy of interpretable histologic features found in the most common brain tumors and was able to accurately segment cancerous regions in SRH images.

No abstract

No abstract

BACKGROUND:Accurate specimen analysis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative specimen interpretation can be challenging because of the wide range of skull base pathologies and lack of intraoperative pathology resources.OBJECTIVE:To develop an independent and parallel intraoperative workflow that can provide rapid and accurate skull base tumor specimen analysis using label-free optical imaging and artificial intelligence.METHODS:We used a fiber laser–based, label-free, nonconsumptive, high-resolution microscopy method (<60 seconds per 1 × 1 mm2), called stimulated Raman histology (SRH), to image a consecutive, multicenter cohort of patients with skull base tumor. SRH images were then used to train a convolutional neural network model using 3 representation learning strategies: cross-entropy, self-supervised contrastive learning, and supervised contrastive learning. Our trained convolutional neural network models were tested on a held-out, multicenter SRH data set.RESULTS:SRH was able to image the diagnostic features of both benign and malignant skull base tumors. Of the 3 representation learning strategies, supervised contrastive learning most effectively learned the distinctive and diagnostic SRH image features for each of the skull base tumor types. In our multicenter testing set, cross-entropy achieved an overall diagnostic accuracy of 91.5%, self-supervised contrastive learning 83.9%, and supervised contrastive learning 96.6%. Our trained model was able to segment tumor-normal margins and detect regions of microscopic tumor infiltration in meningioma SRH images.CONCLUSION:SRH with trained artificial intelligence models can provide rapid and accurate intraoperative analysis of skull base tumor specimens to inform surgical decision-making.