Diagnostic efficacy and interobserver agreement among readers with variable experience of the Prostate Imaging for Recurrence Reporting system with whole-mount histology after androgen deprivation therapy as a reference.

Background: The Prostate Imaging for Recurrence Reporting (PI-RR) system was recently proposed to assess the local recurrence of prostate cancer (PCa), but its exact performance for the prostate after radiotherapy or radical prostatectomy is difficult to determine. We aimed to evaluate the diagnostic performance and interreader agreement of this system using whole-mount histology of the prostate after androgen deprivation therapy (ADT) as the standard of reference.

Methods: In total, 119 patients with PCa post-ADT underwent multiparametric magnetic resonance imaging (mp-MRI) before prostatectomy. Three radiologists analyzed the MRI images independently, scoring imaging findings according to PI-RR. Spearman correlation was performed to assess the relationship between the percentage of sectors with residual cancer and PI-RR score. The diagnostic performance for detection of residual cancer was assessed on a per-sector basis. The chi-squared test was used to compare the cancer detection rate (CDR) among readers. Overall and pairwise interreader agreement in assigning PI-RR categories and residual cancer sectors with a score ≥3 or ≥4 were evaluated with the Cohen kappa coefficient.

Results: Histology revealed 209 sectors with residual cancer. The percentage of pathologically positive sectors increased with the increase in PI-RR score for all readers. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) at a cutoff of score 3 ranged from 74.2% to 83.7%, 86.4% to 92.7%, 51.3% to 64.3%, and 95.4% to 96.9%, respectively, and at a cutoff of score 4, they ranged from 47.4% to 56.5%, 97.9% to 98.6%, 82.5% to 85.3%, and 91.6% to 92.9%, respectively. There was no significant difference among the CDR of readers. In PI-RR categories and detection of residual cancer sectors, overall interreader agreement was moderate for all readers, but agreement was higher between the more experienced readers (moderate to substantial) than between the more and less experienced readers (fair to moderate).

Conclusions: MRI scoring with the PI-RR assessment provided accurate evaluation of PCa after ADT, but readers' experience influenced interreader agreement and cancer diagnosis.