The performance of prediction models can be assessed using a variety of different methods and metrics. Traditional measures for binary and survival outcomes include the Brier score to indicate overall model performance, the concordance (or c) statistic for discriminative ability (or area under the receiver operating characteristic (ROC) curve), and goodness-of-fit statistics for calibration.
Several new measures have recently been proposed that can be seen as refinements of discrimination measures, including variants of the c statistic for survival, reclassification tables, net reclassification improvement (NRI), and integrated discrimination improvement (IDI). Moreover, decision–analytic measures have been proposed, including decision curves to plot the net benefit achieved by making decisions based on model predictions.
We aimed to define the role of these relatively novel approaches in the evaluation of the performance of prediction models. For illustration we present a case study of predicting the presence of residual tumor versus benign tissue in patients with testicular cancer (n=544 for model development, n=273 for external validation).
We suggest that reporting discrimination and calibration will always be important for a prediction model. Decision-analytic measures should be reported if the predictive model is to be used for making clinical decisions. Other measures of performance may be warranted in specific applications, such as reclassification metrics to gain insight into the value of adding a novel predictor to an established model.
Early experience with laparoscopic partial nephrectomy is promising. Laparoscopic partial nephrectomy offered the advantages of less operative time, decreased operative blood loss and a shorter hospital stay. When applied to patients with a single renal tumor 7 cm or less, laparoscopic partial nephrectomy was associated with additional postoperative morbidity compared to open partial nephrectomy. However, equivalent functional and early oncological outcomes were achieved.
Nearly half of patients with recurrent prostate cancer after radical prostatectomy have a long-term PSA response to SRT when treatment is administered at the earliest sign of recurrence. The nomogram we developed predicts the outcome of SRT and should prove valuable for medical decision making for patients with a rising PSA level.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.