Evaluating Clinical Genome Sequence Analysis by Watson for Genomics

Abstract

Background: Oncologists increasingly rely on clinical genome sequencing to pursue effective, molecularly targeted therapies. This study assesses the validity and utility of the artificial intelligence Watson for Genomics (WfG) for analyzing clinical sequencing results.Methods: This study identified patients with solid tumors who participated in in-house genome sequencing projects at a single cancer specialty hospital between April 2013 and October 2016. Targeted genome sequencing results of these patients' tumors, previously analyzed by multidisciplinary specialists at the hospital, were reanalyzed by WfG. This study measures the concordance between the two evaluations.Results: In 198 patients, in-house genome sequencing detected 785 gene mutations, 40 amplifications, and 22 fusions after eliminating single nucleotide polymorphisms. Breast cancer (n = 40) was the most frequent diagnosis in this analysis, followed by gastric cancer (n = 31), and lung cancer (n = 30). Frequently detected single nucleotide variants were found in TP53 (n = 107), BRCA2 (n = 24), and NOTCH2 (n = 23). MYC (n = 10) was the most frequently detected gene amplification, followed by ERBB2 (n = 9) and CCND1 (n = 6). Concordant pathogenic classifications (i.e., pathogenic, benign, or variant of unknown significance) between in-house specialists and WfG included 705 mutations (89.8%; 95% CI, 87.5%−91.8%), 39 amplifications (97.5%; 95% CI, 86.8–99.9%), and 17 fusions (77.3%; 95% CI, 54.6–92.2%). After about 12 months, reanalysis using a more recent version of WfG demonstrated a better concordance rate of 94.5% (95% CI, 92.7–96.0%) for gene mutations. Across the 249 gene alterations determined to be pathogenic by both methods, including mutations, amplifications, and fusions, WfG covered 84.6% (88 of 104) of all targeted therapies that experts proposed and offered an additional 225 therapeutic options.Conclusions: WfG was able to scour large volumes of data from scientific studies and databases to analyze in-house clinical genome sequencing results and demonstrated the potential for application to clinical practice; however, we must train WfG in clinical trial settings.

Comparative analysis of target gene exon sequencing by cognitive technology using a next generation sequencing platform in patients with lung cancer

“…Going forward, it is therefore possible that cognitive technologies such as WfG will be able to assist clinicians by providing the comprehensive and timely analysis needed to help them guide patients to appropriate therapies. This is consistent with the view of Itahashi et al ( 17 ). They believe that WFG is useful for a clinician at a general hospital additional survey of evidence by a clinician is required when evaluating functions ( 17 ).…”

Clinical utility of target capture‐based panel sequencing in hematological malignancies: A multicenter feasibility study

“…The application of artificial intelligence to genomic curation, 35,36 establishing systems to share enormous genomic and clinical data sets for cancer patients, 37 and developing easily available target therapeutics could be helpful in solving this problem.…”

Artificial Intelligence in Clinical Health Care Applications: Viewpoint

“…In 2013, the MD Anderson Cancer Center started using IBM Watson technology to increase effective treatment of cancer patients; however, the project was stopped in 2017 because it “did not meet its goals” [25,26]. In contrast, the concordance with respect to clinical interpretation of single-modality genome sequencing data using Watson for Genomics versus a clinical genomics expert group was reportedly quite good, between 77% and 97%, depending on the type of identified genomic mutations [7].…”

“…In addition to many academic efforts, companies are also getting involved. IBM has developed Watson for several health applications, such as Watson for Oncology and Watson for Genomics, and there is a large number of start-ups addressing all possible aspects of the health continuum [6,7].…”