Objective: With the implementation of American Board of Surgery (ABS) Entrustable Professional Activities (EPAs), there is continued need for objective, evidence-based assessment tools to augment existing microassessments and inform readiness for entrustment. The ENTRUST Assessment Platform is an online virtual-patient simulation platform to assess trainees' surgical decision-making competence across preoperative, intraoperative, and postoperative phases of care. This study collects additional validity evidence for the ENTRUST platform in its relationship to other established variables in competency-based surgical education.
Design: This is a prospective analysis of surgical resident performance on the ENTRUST Right Lower Quadrant (RLQ) pain/Appendicitis EPA Assessment. ENTRUST scores were analyzed by PGY-level and correlations with Accreditation Council for Graduate Medical Education (ACGME) Case Logs, ACGME Surgery Milestones, and ABS In-Service Training Examination (ABSITE) scores were evaluated. Bivariate analyses were performed using Spearman rank correlations.
Setting: This study was conducted at a tertiary academic center (Stanford University, Palo Alto, CA) in a proctored exam setting.
Participants: Thirty-two PGY-1 though PGY-5 general surgery residents completed the ENTRUST RLQ Pain/Appendicitis EPA Assessment containing four case scenarios which were iteratively developed and scored by expert consensus and aligned with ABS EPA definitions.
Results: ENTRUST grand total score was positively correlated with PGY-level (rho = 0.57, p = 0.001), ACGME appendectomy case log volume (rho = 0.55, p = 0.002), and ABSITE raw score (rho = 0.66, p = 0.0004). ENTRUST performance was significantly correlated with all eighteen ACGME Surgery Milestones (rho = 0.43 to rho = 0.54, all p≤0.01), with the strongest correlation seen for PC1 (Patient Evaluation and Decision Making) (rho = 0.54, p = 0.006).
Conclusions: Performance on ENTRUST was significantly correlated with established variables in surgical training, including ACGME Appendectomy Case Logs, ABSITE, and ACGME Surgery Milestones. This study strengthens existing validity evidence for the ENTRUST Assessment Platform as an objective assessment of clinical decision-making. ENTRUST is an assessment tool which can augment microassessments and support competency-based medical education.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.jsurg.2024.09.012 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Goals bias face perception.
J Exp Psychol Gen
January 2025
Department of Cognitive and Psychological Sciences, Brown University.
Faces-the most common and complex stimuli in our daily lives-contain multidimensional information used to infer social attributes that guide consequential behaviors, such as deciding who to trust. Decades of research illustrates that perceptual information from faces is processed holistically. An open question, however, is whether goals might impact this perceptual process, influencing the encoding and representation of the complex social information embedded in faces.
View Article and Find Full Text PDFExploring Maternal Challenges: A Pilot Study of Pain, Fatigue, and Anxiety in Newborn Care Within Rooming-in Settings.
J Clin Med
January 2025
Department of Pediatrics and Coordinated Child Care, Wroclaw Medical University, 50-367 Wroclaw, Poland.
In the rooming-in system, mothers and their healthy newborns stay together for 24 h a day; however, many women in the early postpartum period often find it challenging to balance their recovery from childbirth with the demands of caring for their newborns. This study aims to investigate the need for postpartum women to entrust their newborns to medical staff for care, and the relationship of this need with perceived pain, fatigue, and anxiety. The study uses the Need to Entrust a Newborn under the Care of the Staff (NEN) scale and the Numerical Rating Scale (NRS) to assess participants' levels of pain, fatigue and anxiety.
View Article and Find Full Text PDFResearch Agenda for Entrustable Professional Activities Among US Surgical Specialties.
Ann Surg
January 2025
Department of Surgery, University of Alabama at Birmingham.
The magnitude of advances in surgical care inspires awe consistent with the impact of these developments on patients' lives. With this comes greater knowledge, new practices, and novel technologies for integration into residency training, making the skillset required of today's residents quite different from those in the past. Competency-based medical education and learner-centered approaches offer innovative and studied methodologies for teaching, learning, and assessment to meet the demands of today's educational environment.
View Article and Find Full Text PDFIn this article, the authors propose a repurposing of the concept of entrustment to help guide the use of artificial intelligence (AI) in health professions education (HPE). Entrustment can help identify and mitigate the risks of incorporating generative AI tools with limited transparency about their accuracy, source material, and disclosure of bias into HPE practice. With AI's growing role in education-related activities, like automated medical school application screening and feedback quality and content appraisal, there is a critical need for a trust-based approach to ensure these technologies are beneficial and safe.
View Article and Find Full Text PDFSimulating success: Applying EPA assessments to simulation in surgical education.
Surgery
January 2025
Department of Surgery, Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, AL. Electronic address:
Entrustable professional activities are a competency-based evaluation framework which was deployed by the American Board of Surgery in 2023 to evaluate general surgical residents and provide a path to independent practice. Entrustable professional activity microassessments are based on 18 conditions which are core to being a practicing general surgeon, and most include multiple phases of care, such as preoperative care, intraoperative care, and postoperative care. These evaluations are an amalgam of all the clinical competencies, including medical knowledge and patient care skills.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!