Novel use of a sequential standardized oral board exam to assess PGY1 resident progression.

Purpose: A standardized oral board exam was created to longitudinally assess postgraduate year 1 (PGY1) pharmacy residents in key domains.

Summary: We provide a descriptive review of a novel oral board exam administered quarterly to our PGY1 pharmacy residents. Preceptors from our core rotations (internal medicine/infectious diseases, adult critical care, oncology, pediatrics, and administration/health policy and outcomes) developed questions based on situations commonly encountered by PGY1 residents to assess residents' communication; the content of their response, assessment, and plan; and coachability. Over the 4-year history of this assessment, scoring has matured to consider whether a resident has or has not met or has exceeded expectations for a PGY1 resident at a given stage in their training. Our comprehensive feedback and action planning approach included residents' self-assessment, feedback from the exam committee, development and implementation of a customized training plan for execution, and dissemination to our preceptors. Systematically assessing our PGY1 residents with this innovative method provided a process for tracking their performance and served as a baseline for those who completed additional training at our institution.

Conclusion: A standardized quarterly oral board exam was developed to identify residents' strengths and areas for improvement at established periods during the PGY1 residency training program. This standardized assessment, paired with individualized action plans and open communication with key stakeholders, stimulated development in residents' performance, communication, and interpersonal skills. We aim to expand this system's application to identify predictors of success for candidates we interview for our postgraduate training programs.