BackgroundIt remains unclear when standard systematic reviews and meta-analyses that rely on published aggregate data (AD) can provide robust clinical conclusions. We aimed to compare the results from a large cohort of systematic reviews and meta-analyses based on individual participant data (IPD) with meta-analyses of published AD, to establish when the latter are most likely to be reliable and when the IPD approach might be required.• If both the absolute and relative information size are large, AD meta-analysis results will most likely be reliable, and the collection of IPD only useful if more detailed analyses are required.• Our analyses may have lacked power to identify additional factors that might affect the reliability of AD meta-analyses, and we cannot be sure that our results are applicable to all outcomes and effect measures.� Exact numbers of eligible participants were not available for some (mostly small) unpublished trials, so this is our best estimate. �� Exact values where known, otherwise estimated by use of Formula 13 in Tierney et al. [6]. Percentages are for AD relative to IPD, since the total eligible is unknown. † Chosen a priori by the authors of the present study, on the basis of the research question addressed by the review, in order to assess whether individual trials had an appropriate length of follow-up. ‡ Estimated using all available IPD (i.e., from all trials) combined. ¶ With duplicate trials removed. AD, aggregate data; FU, follow-up; HR, hazard ratio; IPD, individual participant data; KM, Kaplan-Meier; NSCLC, non-small-cell lung cancer.