Generating Real-World Tumor Burden Endpoints from Electronic Health Record Data: Comparison of RECIST, Radiology-Anchored, and Clinician-Anchored Approaches for Abstracting Real-World Progression in Non-Small Cell Lung Cancer

Abstract

IntroductionReal-world evidence derived from electronic health records (EHRs) is increasingly recognized as a supplement to evidence generated from traditional clinical trials. In oncology, tumor-based Response Evaluation Criteria in Solid Tumors (RECIST) endpoints are standard clinical trial metrics. The best approach for collecting similar endpoints from EHRs remains unknown. We evaluated the feasibility of a RECIST-based methodology to assess EHR-derived real-world progression (rwP) and explored non-RECIST-based approaches.MethodsIn this retrospective study, cohorts were randomly selected from Flatiron Health’s database of de-identified patient-level EHR data in advanced non-small cell lung cancer. A RECIST-based approach tested for feasibility (N = 26). Three non-RECIST approaches were tested for feasibility, reliability, and validity (N = 200): (1) radiology-anchored, (2) clinician-anchored, and (3) combined. Qualitative and quantitative methods were used.ResultsA RECIST-based approach was not feasible: cancer progression could be ascertained for 23% (6/26 patients). Radiology- and clinician-anchored approaches identified at least one rwP event for 87% (173/200 patients). rwP dates matched 90% of the time. In 72% of patients (124/173), the first clinician-anchored rwP event was accompanied by a downstream event (e.g., treatment change); the association was slightly lower for the radiology-anchored approach (67%; 121/180). Median overall survival (OS) was 17 months [95% confidence interval (CI) 14, 19]. Median real-world progression-free survival (rwPFS) was 5.5 months (95% CI 4.6, 6.3) and 4.9 months (95% CI 4.2, 5.6) for clinician-anchored and radiology-anchored approaches, respectively. Correlations between rwPFS and OS were similar across approaches (Spearman’s rho 0.65–0.66). Abstractors preferred the clinician-anchored approach as it provided more comprehensive context.ConclusionsRECIST cannot adequately assess cancer progression in EHR-derived data because of missing data and lack of clarity in radiology reports. We found a clinician-anchored approach supported by radiology report data to be the optimal, and most practical, method for characterizing tumor-based endpoints from EHR-sourced data.FundingFlatiron Health Inc., which is an independent subsidiary of the Roche group.Electronic supplementary materialThe online version of this article (10.1007/s12325-019-00970-1) contains supplementary material, which is available to authorized users.

STK11 (LKB1) mutations in metastatic NSCLC: Prognostic value in the real world

“…Real-world progression was determined by physician assessment as described previously [37]; the date and type of progression (actual progression [based on radiographic evidence, pathologic evidence, or clinical assessment], pseudo-progression, or mixed progression) were recorded in the Flatiron database and comprised variables within the dataset. PFS was defined as the time until the earliest record of actual disease progression or death from any cause from initiation of line of therapy (first-or second-line).…”

Association of Programmed Cell Death Ligand 1 Expression Status With Receipt of Immune Checkpoint Inhibitors in Patients With Advanced Non–Small Cell Lung Cancer

“…The patient-level data in the EHRs include structured data in addition to unstructured data collected via technology-enabled medical record abstraction from physician's notes and other unstructured documents (eg, biomarker reports). 18,19 Data provided for this study were deidentified, and provisions were in place to prevent reidentification to protect patients' confidentiality. Rigorous quality control for structured and unstructured data was conducted for this data set.…”

Characterizing the Feasibility and Performance of Real-World Tumor Progression End Points and Their Association With Overall Survival in a Large Advanced Non–Small-Cell Lung Cancer Data Set

“…Our prior work compared multiple methods for curating real-world progression (rwP) from unstructured EHR documents. 7 Here, we evaluate one of those methods in a large, EHR-based cohort of patients with advanced non–small-cell lung cancer (aNSCLC), the leading cause of cancer mortality in the United States. 8 On the basis of a proposed development framework, 9 we examined three questions: Is capturing rwP retrospectively and with sufficient completeness feasible in large cohorts?…”