Study of inter- and intra-observer reproducibility in the interpretation of [18F]choline PET/CT examinations in patients suffering from biochemically recurrent prostate cancer following curative treatment

Abstract

BackgroundThe aim of this study was to investigate the reproducibility of intra- and inter-observer interpretation of [18F]choline positron emission tomography/computed tomography examinations in patients suffering from biochemically recurrent prostate cancer following curative treatment.MethodsA total of 60 patients with biochemical recurrence after curative treatment were included in this bicentric study. The interpretations were based on a systematic analysis of several anatomic regions and all the four nuclear medicine physicians used identical result consoles. The examinations were interpreted with no knowledge of the patients' clinical context. Two months later, a second interpretation of all these examinations was performed using the same method, in random order.ResultsTo evaluate local recurrences, when the prostate is in place, the results showed moderate inter- and intra-observer reproducibility: concordance of all 4 physicians has a Fleiss' kappa coefficient of 0.553 with a confidence interval of (0.425 to 0.693). For patients who had had a prostatectomy, there was excellent concordance for the negative examinations. For the lymphatic basin, inter- and intra-observer reproducibility was excellent with a Fleiss' kappa coefficient of 0.892 with a confidence interval of (0.788 to 0.975). The lymphatic sub-group analysis was also good. For the lymphatic groups in the right or left hemi-pelves, all Fleiss' kappa and Cohen's kappa coefficients are varying from 0.760 to 1 with narrow confidence intervals from (0.536 to 0.984) to (1 to 1) in favour of good/excellent inter-observer reproducibility. To evaluate bone metastasis, inter-observer reproducibility was good with a Fleiss' kappa coefficient of 0.703 and a confidence interval of (0.407 to 0.881).ConclusionOur study is at time the only one on the reproducibility of interpretation of [18F]choline positron emission tomography/computed tomography examinations, which is a key examination for the treatment of patients suffering biochemical recurrence of prostate cancer. Interpretation of the [18F]choline positron emission tomography/computed tomography examination is not so useful at prostate level in patients not previously treated with prostatectomy but has a great interest on patients treated by prostatectomy. It showed good concordance in the interpretation of sub-diaphragmatic lymphatic recurrences as well as in bone metastasis.

Reader Training for the Restaging of Biochemically Recurrent Prostate Cancer Using 18F-Fluciclovine PET/CT

“…Interreader concordance was greatest among prostate/bed lesions (which is also the most common site of BCR prostate cancer), but was also moderate-to-substantial in extraprostatic regions, which is of clinical importance because of the potential of such findings to influence treatment selection. In the same setting of BCR prostate cancer, a previous study of the interpretation of 18 F-choline PET/CT results reported a Fleiss' k-coefficient of 0.550 for the concordance of 4 blinded physicians reading the prostate/prostatic bed region (15). Unlike our study, the readers had at least 1 y of experience in interpreting images with the radiotracer.…”

Intention-to-Treat Analysis of 68Ga-PSMA and 11C-Choline PET/CT Versus CT for Prostate Cancer Recurrence After Surgery

“…Masked image evaluation was performed for CT, and the PET reader was masked to the results of the PET/CT scan with the other radiotracer. In addition, high reproducibility for 68 Ga-PSMA and 11 C-choline PET/CT image interpretation had already been demonstrated by high interobserver agreement (40,41). Because of the large number and overlap of risk factors, we could not calculate biochemical or survival endpoints for these 30 clinical scenarios that could be further individualized by personalized treatment concepts (42).…”

Repeatability of Quantitative 18F-Fluoromethylcholine PET/CT Studies in Prostate Cancer

“…Pegard et al (33) addressed the reproducibility of observer interpretation (i.e., visual evaluation and classification of focally increased uptake as being malignant or benign) of 18 F-fluoromethylcholine PET/CT examinations in patients with biochemically recurrent prostate cancer. The authors found good concordance when evaluating bone metastases and abdominal or pelvic lymphatic recurrences in previously treated patients.…”