Deep Learning to Estimate Human Epidermal Growth Factor Receptor 2 Status from Hematoxylin and Eosin-Stained Breast Tissue Images

Abstract

Context: Several therapeutically important mutations in cancers are economically detected using immunohistochemistry (IHC), which highlights the overexpression of specific antigens associated with the mutation. However, IHC panels can be imprecise and relatively expensive in low-income settings. On the other hand, although hematoxylin and eosin (H&E) staining used to visualize the general tissue morphology is a routine and low cost, it does not highlight any specific antigen or mutation. Aims: Using the human epidermal growth factor receptor 2 (HER2) mutation in breast cancer as an example, we strengthen the case for cost-effective detection and screening of overexpression of HER2 protein in H&E-stained tissue. Settings and Design: We use computational methods that reliably detect subtle morphological changes associated with the over-expression of mutation-specific proteins directly from H&E images. Subjects and Methods: We trained a classification pipeline to determine HER2 overexpression status of H&E stained whole slide images. Our training dataset was derived from a single hospital containing 26 (11 HER2+ and 15 HER2–) cases. We tested the classification pipeline on 26 (8 HER2+ and 18 HER2–) held-out cases from the same hospital and 45 independent cases (23 HER2+ and 22 HER2–) from the TCGA-BRCA cohort. The pipeline was composed of a stain separation module and three deep neural network modules in tandem for robustness and interpretability. Statistical Analysis Used: We evaluate our trained model through area under the curve (AUC)-receiver operating characteristic. Results: Our pipeline achieved an AUC of 0.82 (confidence interval [CI]: 0.65–0.98) on held-out cases and an AUC of 0.76 (CI: 0.61–0.89) on the independent dataset from TCGA. We also demonstrate the region-level correspondence of HER2 overexpression between a patient's IHC and H&E serial sections. Conclusions: Our work strengthens the case for automatically quantifying the overexpression of mutation-specific proteins in H&E-stained digital pathology, and it highlights the importance of multi-stage machine learning pipelines for added robustness and interpretability.

Deep learning predicts gene expression as an intermediate data modality to identify susceptibility patterns in Mycobacterium tuberculosis infected Diversity Outbred mice

“…While much effort continues to perpetuate the successful application of deep learning models to digital pathology, relatively few efforts have been made to connect histopathology to molecular markers such as gene mutations, gene transcripts and proteins. Recent studies have shown that deep learning can identify and localize areas of tissue correlated with specific mutations in the breast [5] , [6] , [7] , lung [8] , and liver [9] cancers; predict microsatellite instability in colorectal [10] and gastrointestinal tumours [11] ; and predict tumour mutational burden in lung [12] and liver [13] cancers. The interest in predicting such signatures of disease stems from the downstream effects on phenotypes – particularly changes in gene expression – which in turn drives research towards particular targeted therapies [14] and informs clinical decisions [ 15 , 16 ].…”

Machine learning-based image analysis for accelerating the diagnosis of complicated preneoplastic and neoplastic ductal lesions in breast biopsy tissues

“…Other AI analyses have been performed for scoring or predicting the expression of biomarkers, such as HER2, Ki-67, estrogen receptor (ER) or progesterone receptor (PgR) [44][45][46][47], and assisting in identi cation of lymph node metastasis [48] or tumor-associated stroma [49]. However, these analyses are not directly related to the pathological diagnosis of complicated breast lesions.…”

Deep Learning of Histopathological Features for the Prediction of Tumour Molecular Genetics

“…In a study by Anand et al, HER2 overexpression was predicted from H&E-stained histopathology slides with an AUC of 0.76 on an independent test set from the TCGA [57]. Three separate neural networks were used in the approach described in this study.…”