Identifying Ectopic Pregnancy in a Large Integrated Health Care Delivery System: Algorithm Validation

Abstract

Background Surveillance of ectopic pregnancy (EP) using electronic databases is important. To our knowledge, no published study has assessed the validity of EP case ascertainment using electronic health records. Objective We aimed to assess the validity of an enhanced version of a previously validated algorithm, which used a combination of encounters with EP-related diagnostic/procedure codes and methotrexate injections. Methods Medical records of 500 women aged 15-44 years with membership at Kaiser Permanente Southern and Northern California between 2009 and 2018 and a potential EP were randomly selected for chart review, and true cases were identified. The enhanced algorithm included diagnostic/procedure codes from the International Classification of Diseases, Tenth Revision, used telephone appointment visits, and excluded cases with only abdominal EP diagnosis codes. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and overall performance (Youden index and F-score) of the algorithm were evaluated and compared to the validated algorithm. Results There were 334 true positive and 166 true negative EP cases with available records. True positive and true negative EP cases did not differ significantly according to maternal age, race/ethnicity, and smoking status. EP cases with only one encounter and non-tubal EPs were more likely to be misclassified. The sensitivity, specificity, PPV, and NPV of the enhanced algorithm for EP were 97.6%, 84.9%, 92.9%, and 94.6%, respectively. The Youden index and F-score were 82.5% and 95.2%, respectively. The sensitivity and NPV were lower for the previously published algorithm at 94.3% and 88.1%, respectively. The sensitivity of surgical procedure codes from electronic chart abstraction to correctly identify surgical management was 91.9%. The overall accuracy, defined as the percentage of EP cases with correct management (surgical, medical, and unclassified) identified by electronic chart abstraction, was 92.3%. Conclusions The performance of the enhanced algorithm for EP case ascertainment in integrated health care databases is adequate to allow for use in future epidemiological studies. Use of this algorithm will likely result in better capture of true EP cases than the previously validated algorithm.

Postpartum Migraine Headache Coding in Electronic Health Records of a Large Integrated Health Care System: Validation Study

“…Furthermore, the individual medical coder's accuracy has been evaluated critically for consistency. Nevertheless, we may still need to develop reliable disease-specific algorithms by using diagnosis coding in combination with other EHRs, including but not limited to pharmacy and utilization records [17]. Therefore, we performed this validation study to evaluate (1) the accuracy of postpartum migraine headache case identification in EHRs and (2) the impact of implementing the ICD-10-CM coding system in extracting data on patients with postpartum migraine headache in the health system.…”

Medication-Wide Association Study Using Electronic Health Record Data of Prescription Medication Exposure and Multifetal Pregnancies: Retrospective Study

“…This also demonstrates that many patients with fertility or ART medications were not assigned the corresponding diagnostic code, indicating that fertility studies using EHR data should include medication history to fully capture affected patients. A recently enhanced algorithm to detect ectopic pregnancy in the EHR used diagnosis and procedure codes as well as medication exposure [ 36 ]. The complete picture of a patient’s medical encounters during pregnancy is likely not captured in the EHR of a health care system (eg, engagement with more than one health care system, over-the-counter medications, etc).…”