Prospective Peer Review in Radiation Therapy Treatment Planning: Long-Term Results From a Longitudinal Study.

Purpose: To present the longitudinal results of a prospective peer review evaluation system (PES) before treatment planning.

Methods And Materials: All cases undergoing radiation therapy (RT) at high-volume academic institutions were graded in daily prospective multidisciplinary contouring rounds (CRs). The clinical suitability for RT, prescription, contours, and written directives were peer reviewed, compared with departmental care pathways, and recorded in a prospective database. Grades were assigned as follows: A (score 4.0) = no deficiencies; B (3.0) = minor modifications of the planning target volume, organs at risk, written directives, or a prescription/care pathway mismatch; and C (2.0) = incomplete target volume or organ-at-risk contours, unsuitable use or inappropriate planned administration of RT, significant contour modifications, prescription changes, or laterality modifications. Information was pooled to determine pretreatment planning work performance by assigning a grade point average (GPA) for each physician as well as compositely.

Results: A total of 11,843 treatment plans from 7854 patients were reviewed using the PES from September 2013 to May 2018. Twenty-seven point nine percent of cases (n = 3303) required modifications before treatment planning commenced. The overall breakdown of grades was 72.1% As, 21.7% Bs, and 6.2% Cs. The median physician CR GPA was 3.60 (average 3.7) with a range of 3.0 to 3.9. Seventy-five percent of physicians demonstrated improvement of their CR GPA since inception of the program, and all physicians demonstrated a drop in the percentage of cases that were assigned a grade of C.

Conclusions: The PES can transparently quantify clinical performance in a single metric. The PES was impactful, with 75% of physicians demonstrating improvement in their CR GPA over time. In contrast to traditional chart rounds, this peer review was meaningful when done before planning commenced, a trend that was observed throughout the study period. Twenty-seven point nine percent of all cases required modification before starting treatment planning, and 6.2% of cases required significant remediation.