No abstract

Background: ROC curves have become the standard for describing and comparing the accuracy of diagnostic tests. Not surprisingly, ROC curves are used often by clinical chemists. Our aims were to observe how the accuracy of clinical laboratory diagnostic tests is assessed, compared, and reported in the literature; to identify common problems with the use of ROC curves; and to offer some possible solutions. Methods: We reviewed every original work using ROC curves and published in Clinical Chemistry in 2001 or 2002. For each article we recorded phase of the research, prospective or retrospective design, sample size, presence/absence of confidence intervals (CIs), nature of the statistical analysis, and major analysis problems. Results: Of 58 articles, 31% were phase I (exploratory), 50% were phase II (challenge), and 19% were phase III (advanced) studies. The studies increased in sample size from phase I to III and showed a progression in the use of prospective designs. Most phase I studies were powered to assess diagnostic tests with ROC areas >0.70. Thirty-eight percent of studies failed to include CIs for diagnostic test accuracy or the CIs were constructed inappropriately. Thirty-three percent of studies provided insufficient analysis for comparing diagnostic tests. Other problems included dichotomization of the gold standard scale and inappropriate analysis of the equivalence of two diagnostic tests. Conclusion: We identify available software and make some suggestions for sample size determination, testing for equivalence in diagnostic accuracy, and alternatives to a dichotomous classification of a continuous-scale

Assessment of metastatic RCC target lesions on CECT for changes in morphology, attenuation, size, and structure by MASS Criteria is more accurate than response assessment by SACT Criteria, RECIST, or modified Choi Criteria. Furthermore, the use of MASS Criteria for imaging response assessment showed high interobserver agreement and may predict disease outcome in patients with metastatic RCC on targeted therapy.

Objectively measuring changes in both tumor size and attenuation on the first CECT study after initiating targeted therapy for metastatic RCC markedly improves response assessment. Distinct patterns of disease recurrence are seen in patients with metastatic RCC on targeted therapy.

No abstract