Dickkopf-1 (DKK1) is a secreted modulator of Wnt signaling that is frequently overexpressed in tumors and associated with poor clinical outcomes. DKN-01 is a humanized monoclonal therapeutic antibody that binds DKK1 with high affinity and has demonstrated clinical activity in gastric/gastroesophageal junction (G/GEJ) patients with elevated tumoral expression of DKK1. Here we report on the validation of a DKK1 RNAscope chromogenic in situ hybridization assay to assess DKK1 expression in G/GEJ tumor tissue. To reduce pathologist time, potential pathologist variability from manual scoring and support pathologist decision making, a digital image analysis algorithm that identifies tumor cells and quantifies the DKK1 signal was developed. Following CLIA guidelines the DKK1 RNAscope chromogenic in situ hybridization assay and digital image analysis algorithm were successfully validated for sensitivity, specificity, accuracy, and precision. The DKK1 RNAscope assay in conjunction with the digital image analysis solution is acceptable for prospective screening of G/GEJ adenocarcinoma patients. The work described here will further advance the companion diagnostic development of our DKK1 RNAscope assay and could generally be used as a guide for the validation of RNAscope assays with digital image quantification.
PD-L1 (22C3) checkpoint inhibitor therapy represents a mainstay of modern cancer immunotherapy for non-small cell lung cancer (NSCLC). In vitro diagnostic (IVD) PD-L1 antibody staining is widely used to predict clinical intervention efficacy. However, pathologist interpretation of this assay is cumbersome and variable, resulting in poor positive predictive value concerning patient therapy response. To address this, we developed a digital assay (DA) termed Tissue Insight (TI) 22C3 NSCLC, for the quantification of PD-L1 in NSCLC tissues, including digital recognition of macrophages and lymphocytes. We completed clinical validation of this digital image analysis solution in 66 NSCLC patient samples, followed by concordance studies (comparison of PD-L1 manual and digital scores) in an additional 99 patient samples. We then combined this DA with three distinct immune cell recognition algorithms for detecting tissue macrophages, alveolar macrophages, and lymphocytes to aid in sample interpretation. Our PD-L1 (22C3) DA was successfully validated and had a scoring agreement (digital to manual) higher than the inter-pathologist scoring. Furthermore, the number of algorithm-identified immune cells showed significant correlation when compared with those identified by immunohistochemistry in serial sections stained by double immunofluorescence. Here, we demonstrated that TI 22C3 NSCLC DA yields comparable results to pathologist interpretation while eliminating the intra- and inter-pathologist variability associated with manual scoring while providing characterization of the immune microenvironment, which can aid in clinical treatment decisions.
The anti-PD-L1 antibody (22C3) is used as a companion diagnostic for successful checkpoint inhibitor therapy in head and neck squamous cell carcinoma. The positive predictive value of this assay, however, is less than ideal as a high PD-L1 score does not necessarily associate with a good response, and a good response may be seen with a low or negative PD-L1 score. In principle, this could be due to lack of accuracy and/or precision of the assay, as well as biological factors, such as variable expression across tumor cells and interacting immune cells. In this study, we describe a digital image analysis algorithm to address assay-related problems and improve both accuracy and precision, as well as improve identification of PD-L1 expression in differing cell populations of the tumor microenvironment. In addition, we propose a panel of assays that in aggregate might reveal inherent heterogeneity among cases with similar PD-L1 score and thus provide vital context underlying the efficacy of checkpoint inhibitors in the clinic. Here we show that applying novel machine-learning based digital image analysis to multiplex assays together with digital scoring of PD-L1 provides an accurate and precise assessment of the real-world tumor milieu that we hypothesize will help establish the immunophenotypes that inform therapeutic efficacy of checkpoint inhibitors. We have additionally interrogated whether expression of PD-L1 in these groups are consistent with known molecular patterns assayed using novel methodologies, such as high-plex digital spatial transcriptomics through the nanoString GeoMx Digital Spatial Profiler (DSP) platform and assessed the ability of the different digital platforms to provide concordant data relating to real-world expression patterns of PD-L1 and associated biomarkers. Thus, our results point to the importance of robust methodologies, used in combination, to evaluate complex tumor immune landscapes and the advantages of digital analyses to provide accurate and precise clinical contexts for better patient outcomes. Citation Format: Clara Troccoli, Lauren Matelski, Adam Beharry, Vanessa Ly, Morgan Wambaugh, Melanie Amen, Will Paces, Geoffrey Metcalf, Roberto Gianani, Tom Turi. Digital and spacial characterization of PD-L1 expression and IVD assay performance in the immune landscape of head and neck squamous cell carcinoma: A multimodal approach [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2023; Part 1 (Regular and Invited Abstracts); 2023 Apr 14-19; Orlando, FL. Philadelphia (PA): AACR; Cancer Res 2023;83(7_Suppl):Abstract nr 6634.
Several studies have shown that the location and expression of infiltrating immune cells in patient tumors can better identify which patients are more likely to respond to anti- PD-1/PD-L1 therapy. In particular, immunohistochemistry-based studies have shown that the spatial location of PD-L1 expression has particular biological relevance, as PD-L1 expression in the tumor cells or immune cells in the tumor syncytium, tumor microenvionment (TME), or tumor-stroma boundary all describe differential PD-L1 biology. Here, we use Flagship’s digital pathology platform (cTA®) to investigate IHC based PD-L1 and CD8 staining patterns in Non-Small Cell Lung (NSCLC) and Urothelial Carcinoma (UC) tissue biopsies. The cTA platform creates thousands of per-cell Biofeatures™ derived from the digital pathology images of the IHC stained tissue, and applies Artificial Intelligence (AI) to the data to summary score endpoints for patient and cohort classification. In this approach, each tissue’s IO landscape is represented using an “IO Scorecard“, which summarizes the IHC biomarker data in a summary score which captures a comprehensive analysis of the tissue sample. The AI-determined scorecard models can be used to monitor changes before and after drug treatment and/or create predictive models for patient response outcomes. In this study, NSCLC and Urothelial Carcinoma samples were sectioned and stained using either the FDA-approved Dako 22C3 or SP263 PD-L1 IHC assays. Serial sections of each tissue specimen were also stained for CD8 expression. The cTA process detected all cells, assigned them to the tumor or TME compartments, and recorded the Biofeatures™ data which characterized PD-L1 or CD8 staining in the Tumor, Tumor/TME margin, or TME compartments. The method was validated by its ability to reproduce pathologist scoring for PD-L1 and CD8. Using the accepted data, we used the AI system to create novel Scorecard based patient classifications which describe differential PD-L1 status, CD8 status, and PD-L1/CD8 status combined. The AI Scorecard approach demonstrated that certain PD-L1 staining Biofeatures™ may also predict the CD8 status of a tumor, suggesting that additional CD8 staining may not be necessary to understand important expression patterns pertaining to cytotoxic T-cells. In summary, we demonstrated how the “IO Scorecards” are able to classify patients into differential immune status cohorts using a novel AI based scoring system, which relies only on PD-L1 IHC staining, by creating a comprehensive, contextual profile of PD-L1 staining that does not require additional CD8 IHC staining to characterize the impact of cytotoxic T-cells in a tissue sample. Citation Format: Charles Caldwell, Will Paces, Jeni Caldara, Bharathi Vennapusa, Joseph S. Krueger. Using digital pathology based “IO Scorecards” to describe relationships between PD-L1 expression and CD8 positive immune cell infiltration [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 3130.
PD-L1 positivity in tumor-associated macrophages has been related to a favorable response to anti-PD-1 and PD-L1 targeted therapies. This concept has driven interest in specifically identifying macrophages in PD-L1 stained tissues, but pathologists often have difficulty in performing this task reliably. Thus, there is a clear need for tools capable of detecting and classifying tumor-associated macrophages in the context of a standardized PDL1 assay. One such method relies on the utilization of image analysis (IA) which measures hundreds of defining cellular features. This is necessary because macrophages identification based on few features would be difficult due to their varying morphologies and similarity with tumor cells. In order to isolate macrophages using multiple aspects of their cellular characteristics, AI and machine learning algorithms were leveraged to provide robust models for their identification. In this study we compare two artificial intelligence (AI) assisted macrophage classification methods for their accuracy in specifically identifying CD68 positive macrophages. Both approaches are based on interrogating a cohort of 20 NSCLC sections with two tumor-associated macrophage recognition algorithms, the first based on a neural network (NN), and the second on a decision tree (DT) model. These classifiers were developed by training a learning model on the morphometric and chromogenic PD-L1 staining features measured on detected cells, using their fluorescent CD68 expression profile as an indicator of their macrophage lineage. These classification algorithms were trained on images developed using procedures wherein tissue sections were stained by immunofluorescence with antibody to the macrophage associated CD68 marker and subsequently scanned to obtain a digital image. After removal of the coverslip and stripping of the CD68 antibodies, the sections were then stained with the anti-PDL1 22C3 antibody and rescanned to obtain a second digital image. Coregistration of the two digital images allowed for the identification of CD68 positive cells in the context of only the 22C3 PDL1 assay. The accuracy of each classification algorithm was determined by comparing the positivity for macrophage lineage among algorithm predicted macrophage to CD68 positivity. For both the NN and the DT classifier, we demonstrated a > 90% accuracy classification of macrophages identification. The decision tree method achieved similarly accurate predictions These data indicate that both NN and DT methods allow for independent identification of macrophages using only a 22C3 IHC PD-L1 assay, making it possible to isolate the contribution of PD-L1 macrophage positivity to successful checkpoint therapy response. Citation Format: Will Paces, Roberto Gianani, Huong Nguyen, Bradley Long, Michael Argyres, Cris Luengo, Rebecca Kim, Charles Caldwell. Image analysis-based identification and quantification of macrophages in PD-L1 (22C3) stained NSCLC tissue sections without additional macrophage-specific staining [abstract]. In: Proceedings of the Annual Meeting of the American Association for Cancer Research 2020; 2020 Apr 27-28 and Jun 22-24. Philadelphia (PA): AACR; Cancer Res 2020;80(16 Suppl):Abstract nr 3879.
BackgroundDetermination of programmed death-ligand 1 (PD-L1) level in tumor by immunohistochemistry (IHC) is widely used to predict response to check point inhibitor therapy. In particular, the Dako PD-L1 (22C3) antibody is a common companion diagnostic to the monoclonal antibody drug Keytruda® (pembrolizumab) in non-small cell lung cancer (NSCLC).1 However, for the practicing pathologist, interpretation of the PD-L1 (22C3) assay is cumbersome and time consuming. Manual pathologist scoring also suffers from poor intra- and inter-pathologist precision, particularly around the cut-off point.2 In this clinical validation study, we developed an image analysis (IA) based solution to accurately and precisely score digital images obtained from PD-L1 stained NSCLC tissues for making clinical enrollment decisions.Methods10 NSCLC tissue samples were purchased from a qualified vendor and IHC stained for PD-L1; 4 of these samples had serial sections stained on two separate days. Stained slides were scanned at 20X magnification and analyzed using Flagship Biosciences’ IA solutions that quantify PD-L1 expression and separate tumor and stromal compartments. Resulting image markups of cell detection and PD-L1 expression were reviewed by an MD pathologist for acceptance. PD-L1 staining was evaluated by digital IA in the sample’s tumor compartment for Total Proportion Score (TPS,%). Assay specificity was defined by ≥ 90% of the tissue cohort exhibiting appropriate cell recognition (≥ 90% cells correctly recognized as determined by the pathologist), with ≤ 10% false positive rate for staining classification. Sensitivity was defined by ≥ 90% of the cohort exhibiting appropriate cell identification (≥ 90% cells correctly identified), with ≤ 10% false negative rate for staining classification. Accuracy was defined by the combination of sensitivity and specificity and precision was defined by concordance of the binned TPS (<1%, ≥ 1%, ≥ 50%) in ≥ 80% of the samples stained on multiple days.ResultsThe preliminary results show that IA can yield high analytical sensitivity, specificity, accuracy, and precision in the determination of the PD-L1 score. 100% of the tissue cohort met criteria for analytical specificity, sensitivity, and accuracy and 100% of the samples stained on multiple days met the precision criteria.ConclusionsThis data demonstrates the feasibility of an IA approach as applied to PD-L1 (22C3) scoring. Ongoing experiments include application of the developed 22C3 algorithm on a separate cohort of 20 NSCLC samples to determine the correlation of digital scoring and scoring obtained by three pathologists. Additionally, we will evaluate the precision obtained by digital scoring in relation to the intra- and inter-pathologist concordance.ReferencesIncorvaia L, Fanale D, Badalamenti G, et al. Programmed death ligand 1 (PD-L1) as a predictive biomarker for pembrolizumab therapy in patients with advanced non-small-cell lung cancer (NSCLC). Adv Ther 2019;36:2600–2617.Rimm DL, Han G, Taube JM, et al. A prospective, multi-institutional, pathologist-based assessment of 4 immunohistochemistry assays for PD-L1 expression in non–small cell lung cancer. JAMA Oncol 2017;3:1051–1058.
e18031 Background: The programmed death-ligand 1 (PD-L1) (22C3) antibody is a companion diagnostic to the check-point inhibitor drug pembrolizumab for head and neck squamous cell carcinoma (HNSCC). Specifically, PD-L1 expression, as determined by a Combined Positive Score (CPS) ≥ 1, defines the clinical decision point for treatment. However, to calculate the CPS, pathologists must account for PD-L1+ tumor cells (TC) and immune cells (IC, i.e., lymphocytes, macrophages) – a cumbersome and time-consuming task that is prone to intra/inter-pathologist variability. We developed a digital image analysis (IA) based solution as a pathologist support tool that accurately and precisely scores images of PD-L1 stained HNSCC tissues. Here we compared the performance of the digital method with manual pathology. To address the literature on the differential regulation of PD-L1 by IC and TC in treatment response, we also examined how PD-L1+ IC contribute to the CPS as compared to PD-L1+ TC. Methods: 19 HNSCC samples were immunohistochemically stained for PD-L1 (22C3). Slides were assessed for CPS by manual pathology: CPS = (# PD-L1 staining cells [TC, lymphocytes, macrophages]/total # viable TC) x 100; wherein CPS < 1 (no PD-L1 expression; no treatment) and CPS ≥ 1 (PD-L1 expression; treatment). Slides were scanned at 20X and analyzed using proprietary IA solutions that identify and separate TC from IC and quantify their PD-L1 expression. Resulting IA markups of cell detection and PD-L1 expression were reviewed by an MD pathologist for accurate cell recognition and stain classification. Upon pathologist approval of the IA performance, PD-L1 staining was evaluated by digital IA for CPS, % PD-L1+ TC, and % PD-L1+ IC. Pearson’s correlation analyses were conducted to assess the concordance between manual and digital CPS along with the association between CPS and PD-L1+ IC versus PD-L1+ TC. Results: Digital and manual CPS were significantly correlated ( r = 0.76, p = 0.00016) and concordant in treatment binning for 14/19 samples; for the 5 discordant samples, manual CPS binned them for no treatment while digital CPS binned them for treatment. Digital CPS significantly correlated with the % PD-L1+ IC ( r = 0.90, p < 0.00001) along with the % PD-L1+ TC ( r = 0.98, p < 0.00001). All 6 samples binned for no treatment by digital CPS had < 1% PD-L1+ IC, whereas all but 2/13 samples binned for treatment by digital CPS had ≥ 1% PD-L1+ IC. Conclusions: The digital method for assessing PD-L1 expression in HNSCC performs similarly to manual pathology with improved accuracy for detecting and quantifying IC versus TC in the CPS calculation. Moreover, the % of PD-L1+ IC seems to contribute substantially to the CPS, to a similar degree as the % of PD-L1+ TC. Given the concordance with manual pathology, this digital method can support pathologists as a clinical diagnostic tool. As such, a clinical validation study of this digital method in a larger HNSCC cohort is underway.
Dickkopf-1 (DKK1) is a secreted modulator of Wnt signaling that is frequently overexpressed in tumors and associated with a poor prognosis. In this study we demonstrate an approach for clinically validating a RNAscope chromogenic in situ hybridization (CISH) assay for determining the level of DKK1 RNA in Gastric (G) and Gastroesophageal (GEJ) tumor tissues according to CLIA guidelines. This two-step process validated first the performance of the wet assay along with the ability of a pathologist to manually score the CISH signal according to a dot-based H-score paradigm, and second the ability of image analysis (IA) software (Flagship Biosciences) to unbiasedly and reproducibly quantify DKK1 staining in the same set of samples. The DKK1 CISH assay for manual scoring passed all pre-determined criteria of sensitivity, specificity, accuracy, and precision. 100% of the 40 evaluated G/GEJ tissues demonstrated acceptable staining in target tumor cells and absence in non-target cells. 100% of the evaluated tissues passed sensitivity with a broad dynamic range of signal expression across target cells, and negligible background staining. Reproducibility was measured by blinded pathology scoring of a serial subset of 12 cases, resulting in 11/12 (92%) with concordant DKK1 H-scores. Accuracy was assessed with a DKK1 qPCR assay on a 20-sample subset and a significant correlation with the H-score data was observed. The IA algorithm also passed all pre-determined criteria of sensitivity, specificity, accuracy, and precision. 36/40 samples (90%) passed analytical specificity with the IA algorithm correctly classifying staining on true cells belonging to the tumor. Failed samples were attributed to non-specific alkaline phosphatase activity, which in practice would be disregarded by the reviewing pathologist. 100% of samples passed the sensitivity criteria of appropriate cell identification and classification. IA precision compared H-scores across 3 days of staining, with 11/12 (92%) cases having concordant DKK1 H-scores and an ICC of 0.9009 (95% CI: 0.7117-0.9601). Digital H-scores were highly correlated to the validated manual H-scores of the 40-sample set (r = 0.72, p <0.0001). Taken together, these data demonstrate a clinically validated DKK1 RNAscope CISH laboratory-derived test (LDT) for manual and IA-assisted pathologist interpretation. The DKK1 RNAscope LDT is currently being applied as part of a phase 2 clinical study of DKN-01 in combination with tislelizumab to prospectively identify previously treated G/GEJ adenocarcinoma patients with elevated DKK1 tumor expression (NCT04363801). Citation Format: Charles Caldwell, Mike Kagey, Sofia Reitsma, Will Paces, Elizabeth Bueche, Vitria Adisetiyo, Roberto Gianani. Clinical validation of a Dickkopf-1 (DKK1) chromogenic in-situ hybridization (CISH) assay for manual and image-analysis assisted pathologist interpretation [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2021; 2021 Apr 10-15 and May 17-21. Philadelphia (PA): AACR; Cancer Res 2021;81(13_Suppl):Abstract nr 433.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.