Bivariate Random Effects Meta-Analysis of ROC Curves

Abstract

Meta-analysis of receiver operating characteristic (ROC)-curve data is often done with fixed-effects models, which suffer many shortcomings. Some random-effects models have been proposed to execute a meta-analysis of ROC-curve data, but these models are not often used in practice. Straightforward modeling techniques for multivariate random-effects meta-analysis of ROC-curve data are needed. The 1st aim of this article is to present a practical method that addresses the drawbacks of the fixed-effects summary ROC (SROC) method of Littenberg and Moses. Sensitivities and specificities are analyzed simultaneously using a bivariate random-effects model. The 2nd aim is to show that other SROC curves can also be derived from the bivariate model through different characterizations of the estimated bivariate normal distribution. Thereby the authors show that the bivariate random-effects approach not only extends the SROC approach but also provides a unifying framework for other approaches. The authors bring the statistical meta-analysis of ROC-curve data back into a framework of relatively standard multivariate meta-analysis with random effects. The analyses were carried out using the software package SAS (Proc NLMIXED).

Diagnostic accuracy of level 3 portable sleep tests versus level 1 polysomnography for sleep-disordered breathing: a systematic review and meta-analysis

“…106 Despite the heterogeneity we saw at some apnea-hypopnea index cut-offs in our metaanalysis, the pooled estimates of diagnostic accuracy parameters appear reliable. We used a model that accounts for this heterogeneity [107][108][109][110] despite the use of different level 3 devices, which each measured the same core parameters.…”

Diagnostic Accuracy of MRI for Assessment of T Category, Lymph Node Metastases, and Circumferential Resection Margin Involvement in Patients with Rectal Cancer: A Systematic Review and Meta-analysis

“…While the Moses-Littenberg method has been widely applied in DTA meta-analyses, it is a fixed effects model which does not account for random variation between studies and ignores correlations in data within studies (79). Although it enables estimation of sensitivity for a given value of specificity, it does not produce average values of sensitivity and specificity (80).…”

Diagnostic Performance of Attenuation-Corrected Myocardial Perfusion Imaging for Coronary Artery Disease: A Systematic Review and Meta-Analysis

“…Publication bias was examined using the effective sample size funnel plot and associated regression test of asymmetry described by Deeks et al (23), with a P value of less than 0.10 for the slope coefficient indicating significant asymmetry. The data were analyzed at the patient level using a bivariate mixed-effects regression model (24)(25)(26) to express the diagnostic performance measures across studies and comparisons between different index tests (25,27).…”