Good Practices for Real‐World Data Studies of Treatment and/or Comparative Effectiveness: Recommendations from the Joint ISPOR‐ISPE Special Task Force on Real‐World Evidence in Health Care Decision Making

Abstract

Purpose: Real-world evidence (RWE) includes data from retrospective or prospective observational studies and observational registries and provides insights beyond those addressed by randomized controlled trials. RWE studies aim to improve health care decision making. Methods: The International Society for Pharmacoeconomics and Outcomes Research (ISPOR)and the International Society for Pharmacoepidemiology (ISPE) created a task force to make recommendations regarding good procedural practices that would enhance decision makers' confidence in evidence derived from RWD studies. Peer review by ISPOR/ISPE members and task force participants provided a consensus-building iterative process for the topics and framing of recommendations.Results: The ISPOR/ISPE Task Force recommendations cover seven topics such as study registration, replicability, and stakeholder involvement in RWE studies. These recommendations, in concert with earlier recommendations about study methodology, provide a trustworthy foundation for the expanded use of RWE in health care decision making. Conclusion:The focus of these recommendations is good procedural practices for studies that test a specific hypothesis in a specific population. We recognize that some of the recommendations in this report may not be widely adopted without appropriate incentives from decision makers, journal editors, and other key stakeholders. KEYWORDScomparative effectiveness, decision making, guidelines, pharmacoepidemiology, real-world data, treatment effectivenessThis is an open access article under the terms of the Creative Commons Attribution-NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.

High Triglycerides Are Associated With Increased Cardiovascular Events, Medical Costs, and Resource Use: A Real‐World Administrative Claims Analysis of Statin‐Treated Patients With High Residual Cardiovascular Risk

“…With regard to statistical analyses, those reported herein should be evaluated in the context of the large sample size, which may indicate statistical significance for some parameters, even when differences are small and not clinically important. Real‐world studies may contain inaccurate recording of health events, missing data, and uncertainty about internal validity 37, 38. In the present study, laboratory test results during the follow‐up period were only available for a subset of patients.…”

Hypertriglyceridemia is associated with an increased risk of peripheral arterial revascularization in high‐risk statin‐treated patients: A large administrative retrospective analysis

“…However, because the data were based on managed care health plan claims, they may not be generalizable to other health care delivery systems. Other limitations of claims data include potential data entry errors, missing data, and uncertainty about internal validity of data; claims data also do not capture certain costs to patients, such as transportation and missed workdays. Importantly, because of the large sample size, small differences that have no clinical relevance may show statistical significance.…”

The International Society for Pharmacoepidemiology's Comments on the Core Recommendations in the Summary of the Heads of Medicines Agencies (HMA) ‐ EMA Joint Big Data Task Force

“…As also pointed out by the HMA/EMA Task Force, we consider a strengthened collaboration between academia, pharmaceutical companies, professional organizations, and regulators essential to further this progress. In addition, and as also highlighted in previous EMA work, strong emphasis on the transparent reporting of designs and methodological choices and the application of best pharmacoepidemiologic practices will be essential in evolving the field further . Of note, this applies regardless of the specific nature of the real world data (RWD) used.…”