Publications by authors named "Andrew K Hall"

Introduction: Debriefing after simulation facilitates reflective thinking and learning. Eye-tracking augmented debriefing (ETAD) may provide advantages over traditional debriefing (TD) by leveraging video replay with first-person perspective. This multisite randomized controlled trial compared the impact of ETAD with TD (without eye-tracking and without video) after simulation on 4 outcomes: (1) resident metacognitive awareness (the primary outcome), (2) cognitive load (CL) of residents and debriefers, (3) alignment of resident self-assessment and debriefer assessment scores, and (4) resident and debriefer perceptions of the debriefing experience.

View Article and Find Full Text PDF

Background: As competency-based medical education (CBME) curricula are introduced in residency programs across Canada, systematic evaluation efforts are needed to ensure fidelity of implementation. This study evaluated early outcomes of CBME implementation in one Canadian Physical Medicine and Rehabilitation program that was an early adopter of CBME, with an aim to inform continuous quality improvement initiatives and CBME implementation nationwide.

Methods: Using Rapid Evaluation methodology, informed by the CBME Core Components Framework, the intended outcomes of CBME were compared to actual outcomes.

View Article and Find Full Text PDF

Introduction: As an early adopter of competency-based medical education (CBME) our postgraduate institution was uniquely positioned to analyze implementation experience data across programs, while keeping institutional factors constant. We described participants' experiences related to CBME implementation across programs derived from early program evaluation efforts within our setting.

Methods: This evaluation focused on eight residency programs at a medium-sized academic institution in Canada.

View Article and Find Full Text PDF

Objectives: In 2017, Queen's University launched Competency-Based Medical Education (CBME) across 29 programs simultaneously. Two years post-implementation, we asked key stakeholders (faculty, residents, and program leaders) within the Pediatrics program for their perspectives on and experiences with CBME so far.

Methods: Program leadership explicitly described the intended outcomes of implementing CBME.

View Article and Find Full Text PDF

Postgraduate medical education is an essential societal enterprise that prepares highly skilled physicians for the health workforce. In recent years, PGME systems have been criticized worldwide for problems with variable graduate abilities, concerns about patient safety, and issues with teaching and assessment methods. In response, competency based medical education approaches, with an emphasis on graduate outcomes, have been proposed as the direction for 21st century health profession education.

View Article and Find Full Text PDF

Objective: Approximately five years ago, the Royal College emergency medicine programs in Canada implemented a competency-based paradigm and introduced the use of Entrustable Professional Activities (EPAs) for assessment of units of professional activity to assess trainees. Many competency-based medical education (CBME) based curricula, involve assessing for entrustment through observations of EPAs. While EPAs are frequently assessed in clinical settings, simulation is also used.

View Article and Find Full Text PDF

Program evaluation is an essential, but often neglected, activity in any transformational educational change. Competence by Design was a large-scale change initiative to implement a competency-based time-variable educational system in Canadian postgraduate medical education. A program evaluation strategy was an integral part of the build and implementation plan for CBD from the beginning, providing insights into implementation progress, challenges, unexpected outcomes, and impact.

View Article and Find Full Text PDF
Article Synopsis
  • - Competence committees (CCs) are a new approach in health professions education aimed at enhancing assessment decision-making by allowing trained educators to review learners' progress via structured portfolios.
  • - The implementation of CCs on a national scale is complicated due to necessary cultural shifts, logistical challenges, and the diverse skills required for success, as demonstrated by the Royal College of Physicians and Surgeons of Canada's experiences.
  • - A successful CC implementation requires balancing standardization with flexibility to meet individual program needs, using multiple engagement strategies for local adaptation, and planning for ongoing evaluation from the start.
View Article and Find Full Text PDF

Traditional approaches to assessment in health professions education systems, which have generally focused on the summative function of assessment through the development and episodic use of individual high-stakes examinations, may no longer be appropriate in an era of competency based medical education. Contemporary assessment programs should not only ensure collection of high-quality performance data to support robust decision-making on learners' achievement and competence development but also facilitate the provision of meaningful feedback to learners to support reflective practice and performance improvement. Programmatic assessment is a specific approach to designing assessment systems through the intentional selection and combination of a variety of assessment methods and activities embedded within an educational framework to simultaneously optimize the decision-making and learning function of assessment.

View Article and Find Full Text PDF

Coaching is an increasingly popular means to provide individualized, learner-centered, developmental guidance to trainees in competency based medical education (CBME) curricula. Aligned with CBME's core components, coaching can assist in leveraging the full potential of this educational approach. With its focus on growth and improvement, coaching helps trainees develop clinical acumen and self-regulated learning skills.

View Article and Find Full Text PDF

Although just-in-time training (JIT) is increasingly used in simulation-based health professions education, its impact on learning, performance, and patient outcomes remains uncertain. The aim of this study was to determine whether JIT simulation training leads to improved learning and performance outcomes. We included randomized or nonrandomized interventional studies assessing the impact of JIT simulation training (training conducted in temporal or spatial proximity to performance) on learning outcomes among health professionals (trainees or practitioners).

View Article and Find Full Text PDF

Background: Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist.

Methods: Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.

View Article and Find Full Text PDF

Background: Simulation-based assessment can complement workplace-based assessment of rare or difficult to assess Entrustable Professional Activities (EPAs). We aimed to compare the use of simulation-based assessment for resuscitation-focused EPAs in three postgraduate medical training programs and describe faculty perceptions of simulation-based assessment.

Methods: EPA assessment scores and setting (simulation or workplace) were extracted from 2017-2020 for internal medicine, emergency medicine, and surgical foundations residents at the transition to discipline and foundations of discipline stages.

View Article and Find Full Text PDF

Objective: The purpose of this study was to identify the learning needs of emergency physicians returning to Emergency Medicine (EM) practice after clinical leaves of less than 2 years, summarize existing return to practice programs, and propose recommendations regarding ideal educational and support structures for these physicians both during their practice gaps and upon return to EM.

Methods: A multiple-phased study was conducted to establish recommendations regarding ideal educational and support structures for emergency physicians returning from practice gaps of less than 2 years. The overall design involved an initial environmental scan of existing and exemplar programs and regulatory body positions, followed by interviews with EM Department Heads from across Canada, and then subsequent content analysis and recommendation derivation by EM medical education expert group consensus.

View Article and Find Full Text PDF

Residents and faculty have described a burden of assessment related to the implementation of competency-based medical education (CBME), which may undermine its benefits. Although this concerning signal has been identified, little has been done to identify adaptations to address this problem. Grounded in an analysis of an early Canadian pan-institutional CBME adopter's experience, this article describes postgraduate programs' adaptations related to the challenges of assessment in CBME.

View Article and Find Full Text PDF

Objectives: Simulation-based technical skills training is now ubiquitous in medicine, particularly for high acuity, low occurrence (HALO) procedures. Mastery learning and deliberate practice (ML + DP) are potentially valuable educational methods, however, they are resource intensive. We sought to compare the effect of deliberate practice and mastery learning versus self-guided practice on skill performance of the rare, life-saving procedure, a bougie-assisted cricothyroidotomy (BAC).

View Article and Find Full Text PDF

Objectives: To evaluate the impact and feasibility of multisource feedback compared with traditional feedback for trauma team captains (TTCs).

Design: A mixed-methods, non-randomised prospective study.

Setting: A level one trauma centre in Ontario, Canada.

View Article and Find Full Text PDF

Introduction Emergency medicine (EM) postgraduate medical education in Canada has transitioned from traditional time-based training to competency-based medical education (CBME). In order to promote residents through stages of training, simulated assessments are needed to evaluate residents in high-stakes but low-frequency medical emergencies. There remains a gap in the literature pertaining to the use of evaluative tools in simulation, such as the Resuscitation Assessment Tool (RAT) in the new CBME curriculum design.

View Article and Find Full Text PDF

Background: The CanMEDS physician competency framework will be updated in 2025. The revision occurs during a time of disruption and transformation to society, healthcare, and medical education caused by the COVID-19 pandemic and growing acknowledgement of the impacts of colonialism, systemic discrimination, climate change, and emerging technologies on healthcare and training. To inform this revision, we sought to identify emerging concepts in the literature related to physician competencies.

View Article and Find Full Text PDF
Article Synopsis
  • - The study aimed to identify and align Global Health competencies with the CanMEDS framework in postgraduate medical education to evaluate how they correspond and differ.
  • - Using a scoping review methodology, the researchers analyzed 19 articles that highlighted competencies necessary for Global Health training, finding 36 competencies that mostly correlated with CanMEDS roles.
  • - The results indicated that while many Global Health competencies matched existing CanMEDS standards, there are additional competencies that may enhance future physician competency frameworks.
View Article and Find Full Text PDF

Importance: Prior studies have revealed gender differences in the milestone and clinical competency committee assessment of emergency medicine (EM) residents.

Objective: To explore gender disparities and the reasons for such disparities in the narrative comments from EM attending physicians to EM residents.

Design, Setting, And Participants: This multicenter qualitative analysis examined 10 488 narrative comments among EM faculty and EM residents between 2015 to 2018 in 5 EM training programs in the US.

View Article and Find Full Text PDF

Purpose: Organizational readiness is critical for successful implementation of an innovation. We evaluated program readiness to implement Competence by Design (CBD), a model of Competency-Based Medical Education (CBME), among Canadian postgraduate training programs.

Methods: A survey of program directors was distributed 1 month prior to CBD implementation in 2019.

View Article and Find Full Text PDF

Objective Emergency Medicine (EM) Sim Cases was initially developed in 2015 as a free open-access simulation resource. To ensure the future of EM Sim Cases remains relevant and up to date, we performed a needs assessment to better define our audience and facilitate long-term goals. Methods We delivered a survey using a modified massive-online-needs-assessment methodology through an iterative process with simulation experts from the EM Simulation Educators Research Collaborative.

View Article and Find Full Text PDF