Concordance between treatment recommendations provided by IBM Watson for Oncology and a multidisciplinary tumor board for breast cancer in China

Abstract

Objective Watson for Oncology (WFO), an artificial intelligence from IBM Corporation, can provide a treatment plan by analyzing patient’s disease characteristics. The present study was performed to examine the concordance between treatment recommendations proposed by WFO and the multidisciplinary tumor board at our center. The aim was to explore the feasibility of using WFO for breast cancer cases in China and to ascertain the ways to make WFO more suitable for Chinese patients with breast cancer. Methods Data from 302 breast cancer patients treated at the Second Affiliated Hospital of Xi’an Jiaotong University between October 2016 and February 2018 was retrieved and retrospectively analyzed by WFO. The recommendations were divided into ‘recommended’, ‘considered’ and ‘not recommended’ groups. Results were considered concordant when oncologists’ recommendations were categorized as ‘recommended’ or ‘for consideration’ by WFO. Results The concordance rate of 200 subjects with postoperative adjuvant therapy was 77%. However, the rate was 27.5% in the remaining 102 cases with metastatic disease receiving either first-line or no treatment. Further analysis demonstrated that inconsistencies were mainly due to different choices of chemotherapy regimens. Subgroup study indicates that tumor stage, receptor status and age also had influences at the concordance rate. Conclusion The results of this study suggest that WFO is a promising artificial intelligence system for the treatment of breast cancer. These findings can also serve as a reference framework for the inclusion of artificial intelligence in the ongoing medical reform in China.

Use and accuracy of decision support systems using artificial intelligence for tumor diseases: a systematic review and meta-analysis

“…Thirteen studies of breast cancer were conducted, involving a total of 7786 subjects ( 15 , 16 , 18 – 21 , 27 , 34 , 36 , 38 , 43 – 45 ). The number of participants per study varied widely, ranging from 55 ( 27 ) to 1,977 ( 36 ).…”

Data-driven support to decision-making in molecular tumour boards for lymphoma: A design science approach

“…( 72 ) developed a “MTB Virtual Assistant”, which used NLP in clinical diagnostic reports to transform the information into structured data and applied models to assess the disease staging. IBM launched IBM Watson for Oncology, a CDSS which uses machine learning to learn from clinical guidelines and recommend a treatment plan ( 43 – 45 ). Instead, the current study suggested a recommender system based on continual learning, which could progressively learn from their mistakes and improve their performance.…”

“…An early solution was the IBM Watson for Oncology, an AI-based CDSS for lung, breast, and prostate cancer. Evaluation articles report on the concordance between recommendations made and MTBs ( 43 – 45 ). The concordance was very good but it varied with the stage of the cancer type.…”

Artificial intelligence in clinical decision support systems for oncology

“…It can also play an important role in reducing doctors' workload and training young doctors. In addition, WFO would regulate the treatment of cancers nationwide and enhance the trust between doctors and patients, especially in rural hospitals 13 , 48 .…”