Good practices for real‐world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR‐ISPE Special Task Force on real‐world evidence in health care decision making

Abstract

PurposeReal‐world evidence (RWE) includes data from retrospective or prospective observational studies and observational registries and provides insights beyond those addressed by randomized controlled trials. RWE studies aim to improve health care decision making.MethodsThe International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) created a task force to make recommendations regarding good procedural practices that would enhance decision makers' confidence in evidence derived from RWD studies. Peer review by ISPOR/ISPE members and task force participants provided a consensus‐building iterative process for the topics and framing of recommendations.ResultsThe ISPOR/ISPE Task Force recommendations cover seven topics such as study registration, replicability, and stakeholder involvement in RWE studies. These recommendations, in concert with earlier recommendations about study methodology, provide a trustworthy foundation for the expanded use of RWE in health care decision making.ConclusionThe focus of these recommendations is good procedural practices for studies that test a specific hypothesis in a specific population. We recognize that some of the recommendations in this report may not be widely adopted without appropriate incentives from decision makers, journal editors, and other key stakeholders.

Observational research on sodium glucose co‐transporter‐2 inhibitors: A real breakthrough?

“…Therefore, before pooling data through meta‐analysis (MA), validity remains a crucial aspect of study design and conception 25, 26, 27, 28. In particular, validation of the diagnoses is critical in the diabetes area, especially when in multinational epidemiological studies,29 because the lack of clinical data may compromise optimal algorithms for patients' and outcomes' identification.…”

Reporting to Improve Reproducibility and Facilitate Validity Assessment for Healthcare Database Studies V1.0

“…This is addressed in detail in a companion paper led by ISPOR. 37 Because the initially planned research and the design and methodology underlying reported results may differ, it is also important to have transparency regarding what researchers actually did to obtain the reported results from a healthcare database study. This can be achieved with clear reporting on the detailed operational decisions made by investigators during implementation.…”

Using Machine Learning to Identify Health Outcomes from Electronic Health Record Data

“…Real-world data refers to “data obtained outside the context of randomized controlled trials generated during routine clinical practice” (4). Electronic health records (EHRs) and insurance claims are perhaps the most common sources of real-world data used for health outcomes research and pragmatic clinical trials (4, 5). Compared to claims data, EHR data may have greater utility for identifying health outcomes due to the presence of richer clinical information including vital signs, laboratory test results, progress notes, discharge summaries, and radiologic and pathologic images and reports, among other information (6).…”