Youden Index and Optimal Cut‐Point Estimated from Observations Affected by a Lower Limit of Detection

Abstract

SummaryThe receiver operating characteristic (ROC) curve is used to evaluate a biomarker's ability for classifying disease status. The Youden Index (J), the maximum potential effectiveness of a biomarker, is a common summary measure of the ROC curve. In biomarker development, levels may be unquantifiable below a limit of detection (LOD) and missing from the overall dataset. Disregarding these observations may negatively bias the ROC curve and thus J. Several correction methods have been suggested for mean estimation and testing; however, little has been written about the ROC curve or its summary measures. We adapt non-parametric (empirical) and semi-parametric (ROC-GLM [generalized linear model]) methods and propose parametric methods (maximum likelihood (ML)) to estimate J and the optimal cut-point (c*) for a biomarker affected by a LOD. We develop unbiased estimators of J and c* via ML for normally and gamma distributed biomarkers. Alpha level confidence intervals are proposed using delta and bootstrap methods for the ML, semi-parametric, and non-parametric approaches respectively. Simulation studies are conducted over a range of distributional scenarios and sample sizes evaluating estimators' bias, root-mean square error, and coverage probability; the average bias was less than one percent for ML and GLM methods across scenarios and decreases with increased sample size. An example using polychlorinated biphenyl levels to classify women with and without endometriosis illustrates the potential benefits of these methods. We address the limitations and usefulness of each method in order to give researchers guidance in constructing appropriate estimates of biomarkers' true discriminating capabilities.

Efficacy of Pap Test in Combination with ThinPrep Cytological Test in Screening for Cervical Cancer

“…The Youden Index is a receiver operating curve (ROC) summary statistic that optimizes a biomarker's differentiating ability by giving equal weight is given to sensitivity and specificity (Ruopp et al, 2008). In the present study, we compared the Youden Index of different methods of screening, and found that the Youden Index of combined testing was markedly higher than that of the Pap test and the TCT, but the Youden Index of the Pap test was comparable with that of the TCT.…”

Prospective validation of an automated chemiluminescence-based assay of renin and aldosterone for the work-up of arterial hypertension

“…The Youden index (J), a main summary statistic of the ROC curve defined as J = max (c) [sensitivity (c)+specificity (c)−1], was employed to determine the optimal cutoff (c*). This was defined as the value that optimizes the ARR's dis criminating ability in that it corresponds to the highest average of sensitivity and specificity [23]. The significance was set at p < 0.05.…”

Measurement of Fecal Calprotectin Improves Monitoring and Detection of Recurrence of Crohn's Disease After Surgery

“…The optimal cut-off values for FC concentration for assessment and prediction of endoscopic recurrence were determined using logistic regression in combination with the senspec command in STATA12 and Youden Index. 33,34 There were three cohorts used for analysis:…”