BACKGROUND: MRI is increasingly being used for rectal cancer staging. The

A synoptic MRI report for preoperative staging of rectal cancer was successfully developed and pilot tested in the province of Ontario, Canada.

No abstract

BACKGROUND: Although the accuracy of preoperative MRI staging has been established on follow-up histopathologic examination, the reproducibility of MRI staging has been evaluated in studies with expert radiologists reading a large sample of MRI images and therefore is not generalizable to the real-world setting. OBJECTIVE: The purpose of this study was to evaluate the interrater reliability of MRI for distance to the mesorectal fascia, T category, mesorectal lymph node status, and extramural depth of invasion for preoperative staging of primary rectal cancer. DESIGN: This was a prospective, cross-sectional survey. SETTINGS: The study was conducted in Ontario, Canada. PARTICIPANTS: Participants included GI radiologists. INTERVENTIONS: Participants read 5 preselected staging MRIs using a synoptic report and participated in an educational Webinar. MAIN OUTCOME MEASURES: Distance to the mesorectal fascia, T category, extramural depth of invasion, and mesorectal lymph node status for each MRI were abstracted. Data were analyzed in aggregate using percentage of agreement, Fleiss κ, and interclass correlation coefficients to assess interrater reliability. RESULTS: Reliability was highest for distance to the mesorectal fascia with an intraclass correlation of 0.58 (95% CI, 0.27–0.80). Kappa scores for T category, mesorectal lymph node status, and extramural depth of invasion were 0.38 (95% CI, 0.23–0.46), 0.41 (95% CI, 0.32–0.49), and 0.37 (95% CI, 0.16–0.82). There was no difference when radiologists were stratified by experience or volume. LIMITATIONS: Scores may have been affected by MRI selection, because they were chosen to demonstrate diagnostic challenges for the Webinar and did not reflect a representative sample. CONCLUSIONS: Interrater reliability was highest for distance to mesorectal fascia, and therefore, it may be a more reliable criterion than T category, extramural depth of invasion, or mesorectal lymph node status. Combined with the fact that an uninvolved mesorectal fascia is more consistent with the overall goal of rectal cancer surgery, it should be considered as an important MRI criterion for preoperative treatment decision making in the real-world setting. See Video Abstract at http://links.lww.com/DCR/A763.