Introduction: Debriefing after simulation facilitates reflective thinking and learning. Eye-tracking augmented debriefing (ETAD) may provide advantages over traditional debriefing (TD) by leveraging video replay with first-person perspective. This multisite randomized controlled trial compared the impact of ETAD with TD (without eye-tracking and without video) after simulation on 4 outcomes: (1) resident metacognitive awareness (the primary outcome), (2) cognitive load (CL) of residents and debriefers, (3) alignment of resident self-assessment and debriefer assessment scores, and (4) resident and debriefer perceptions of the debriefing experience.
View Article and Find Full Text PDFBackground: As competency-based medical education (CBME) curricula are introduced in residency programs across Canada, systematic evaluation efforts are needed to ensure fidelity of implementation. This study evaluated early outcomes of CBME implementation in one Canadian Physical Medicine and Rehabilitation program that was an early adopter of CBME, with an aim to inform continuous quality improvement initiatives and CBME implementation nationwide.
Methods: Using Rapid Evaluation methodology, informed by the CBME Core Components Framework, the intended outcomes of CBME were compared to actual outcomes.
Introduction: As an early adopter of competency-based medical education (CBME) our postgraduate institution was uniquely positioned to analyze implementation experience data across programs, while keeping institutional factors constant. We described participants' experiences related to CBME implementation across programs derived from early program evaluation efforts within our setting.
Methods: This evaluation focused on eight residency programs at a medium-sized academic institution in Canada.
Objectives: In 2017, Queen's University launched Competency-Based Medical Education (CBME) across 29 programs simultaneously. Two years post-implementation, we asked key stakeholders (faculty, residents, and program leaders) within the Pediatrics program for their perspectives on and experiences with CBME so far.
Methods: Program leadership explicitly described the intended outcomes of implementing CBME.
Postgraduate medical education is an essential societal enterprise that prepares highly skilled physicians for the health workforce. In recent years, PGME systems have been criticized worldwide for problems with variable graduate abilities, concerns about patient safety, and issues with teaching and assessment methods. In response, competency based medical education approaches, with an emphasis on graduate outcomes, have been proposed as the direction for 21st century health profession education.
View Article and Find Full Text PDFObjective: Approximately five years ago, the Royal College emergency medicine programs in Canada implemented a competency-based paradigm and introduced the use of Entrustable Professional Activities (EPAs) for assessment of units of professional activity to assess trainees. Many competency-based medical education (CBME) based curricula, involve assessing for entrustment through observations of EPAs. While EPAs are frequently assessed in clinical settings, simulation is also used.
View Article and Find Full Text PDFProgram evaluation is an essential, but often neglected, activity in any transformational educational change. Competence by Design was a large-scale change initiative to implement a competency-based time-variable educational system in Canadian postgraduate medical education. A program evaluation strategy was an integral part of the build and implementation plan for CBD from the beginning, providing insights into implementation progress, challenges, unexpected outcomes, and impact.
View Article and Find Full Text PDFTraditional approaches to assessment in health professions education systems, which have generally focused on the summative function of assessment through the development and episodic use of individual high-stakes examinations, may no longer be appropriate in an era of competency based medical education. Contemporary assessment programs should not only ensure collection of high-quality performance data to support robust decision-making on learners' achievement and competence development but also facilitate the provision of meaningful feedback to learners to support reflective practice and performance improvement. Programmatic assessment is a specific approach to designing assessment systems through the intentional selection and combination of a variety of assessment methods and activities embedded within an educational framework to simultaneously optimize the decision-making and learning function of assessment.
View Article and Find Full Text PDFCoaching is an increasingly popular means to provide individualized, learner-centered, developmental guidance to trainees in competency based medical education (CBME) curricula. Aligned with CBME's core components, coaching can assist in leveraging the full potential of this educational approach. With its focus on growth and improvement, coaching helps trainees develop clinical acumen and self-regulated learning skills.
View Article and Find Full Text PDFAlthough just-in-time training (JIT) is increasingly used in simulation-based health professions education, its impact on learning, performance, and patient outcomes remains uncertain. The aim of this study was to determine whether JIT simulation training leads to improved learning and performance outcomes. We included randomized or nonrandomized interventional studies assessing the impact of JIT simulation training (training conducted in temporal or spatial proximity to performance) on learning outcomes among health professionals (trainees or practitioners).
View Article and Find Full Text PDFBackground: Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist.
Methods: Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.
Background: Simulation-based assessment can complement workplace-based assessment of rare or difficult to assess Entrustable Professional Activities (EPAs). We aimed to compare the use of simulation-based assessment for resuscitation-focused EPAs in three postgraduate medical training programs and describe faculty perceptions of simulation-based assessment.
Methods: EPA assessment scores and setting (simulation or workplace) were extracted from 2017-2020 for internal medicine, emergency medicine, and surgical foundations residents at the transition to discipline and foundations of discipline stages.
Objective: The purpose of this study was to identify the learning needs of emergency physicians returning to Emergency Medicine (EM) practice after clinical leaves of less than 2 years, summarize existing return to practice programs, and propose recommendations regarding ideal educational and support structures for these physicians both during their practice gaps and upon return to EM.
Methods: A multiple-phased study was conducted to establish recommendations regarding ideal educational and support structures for emergency physicians returning from practice gaps of less than 2 years. The overall design involved an initial environmental scan of existing and exemplar programs and regulatory body positions, followed by interviews with EM Department Heads from across Canada, and then subsequent content analysis and recommendation derivation by EM medical education expert group consensus.
Residents and faculty have described a burden of assessment related to the implementation of competency-based medical education (CBME), which may undermine its benefits. Although this concerning signal has been identified, little has been done to identify adaptations to address this problem. Grounded in an analysis of an early Canadian pan-institutional CBME adopter's experience, this article describes postgraduate programs' adaptations related to the challenges of assessment in CBME.
View Article and Find Full Text PDFObjectives: Simulation-based technical skills training is now ubiquitous in medicine, particularly for high acuity, low occurrence (HALO) procedures. Mastery learning and deliberate practice (ML + DP) are potentially valuable educational methods, however, they are resource intensive. We sought to compare the effect of deliberate practice and mastery learning versus self-guided practice on skill performance of the rare, life-saving procedure, a bougie-assisted cricothyroidotomy (BAC).
View Article and Find Full Text PDFObjectives: To evaluate the impact and feasibility of multisource feedback compared with traditional feedback for trauma team captains (TTCs).
Design: A mixed-methods, non-randomised prospective study.
Setting: A level one trauma centre in Ontario, Canada.
Introduction Emergency medicine (EM) postgraduate medical education in Canada has transitioned from traditional time-based training to competency-based medical education (CBME). In order to promote residents through stages of training, simulated assessments are needed to evaluate residents in high-stakes but low-frequency medical emergencies. There remains a gap in the literature pertaining to the use of evaluative tools in simulation, such as the Resuscitation Assessment Tool (RAT) in the new CBME curriculum design.
View Article and Find Full Text PDFBackground: The CanMEDS physician competency framework will be updated in 2025. The revision occurs during a time of disruption and transformation to society, healthcare, and medical education caused by the COVID-19 pandemic and growing acknowledgement of the impacts of colonialism, systemic discrimination, climate change, and emerging technologies on healthcare and training. To inform this revision, we sought to identify emerging concepts in the literature related to physician competencies.
View Article and Find Full Text PDFImportance: Prior studies have revealed gender differences in the milestone and clinical competency committee assessment of emergency medicine (EM) residents.
Objective: To explore gender disparities and the reasons for such disparities in the narrative comments from EM attending physicians to EM residents.
Design, Setting, And Participants: This multicenter qualitative analysis examined 10 488 narrative comments among EM faculty and EM residents between 2015 to 2018 in 5 EM training programs in the US.
Purpose: Organizational readiness is critical for successful implementation of an innovation. We evaluated program readiness to implement Competence by Design (CBD), a model of Competency-Based Medical Education (CBME), among Canadian postgraduate training programs.
Methods: A survey of program directors was distributed 1 month prior to CBD implementation in 2019.
Objective Emergency Medicine (EM) Sim Cases was initially developed in 2015 as a free open-access simulation resource. To ensure the future of EM Sim Cases remains relevant and up to date, we performed a needs assessment to better define our audience and facilitate long-term goals. Methods We delivered a survey using a modified massive-online-needs-assessment methodology through an iterative process with simulation experts from the EM Simulation Educators Research Collaborative.
View Article and Find Full Text PDF