Systematic review and narrative synthesis of competency-based medical education in anaesthesia.

Br J Anaesth

Centre for Medical and Health Sciences Education, School of Medicine, University of Auckland, Auckland, New Zealand.

Published: June 2020

Background: Competency-based medical education (CBME) addresses the accountability of postgraduate training programmes to graduate specialists capable of independent practice.

Methods: We undertook a systematic review and narrative synthesis of the published CBME literature in anaesthesia training programmes to identify current practices and areas requiring further exploration.

Results: We grouped the 23 studies that met our inclusion criteria into the following categories: demonstrating outcomes of CBME, developing a consensus on an achievable CBME curriculum, CBME curriculum framework, design and implementation of workplace-based assessment (WBA) tools, trainee self-assessment, perceptions of trainees and supervisors on WBA tools, and technological solutions for assessment and feedback. Included studies reported variable success in reaching consensus in competency outcome frameworks for sequenced progression and limited research on approaches to curriculum delivery, whilst the majority of studies focused on workplace assessment. Studies supported the use of entrustment scales, where assessors make a judgement on the extent to which the trainee can manage a case independently. While evidence supported the reliability of WBA tools, and predicted the numbers needed for high-stakes decisions, areas of concern related to factors influencing the value WBA tools in promoting trainee learning, and variable perceptions of their value in making decisions on progression.

Conclusions: Evidence on outcomes of CBME was limited to acquisition of specific competencies during training. The large number of unanswered questions and the dearth of studies across the core components of CBME suggest that we need a collaborative approach to create the evidence required to implement CBME wisely and cost effectively, to have positive impacts on patients, trainees, and healthcare systems.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.bja.2019.10.025DOI Listing

Publication Analysis

Top Keywords

wba tools
16
systematic review
8
review narrative
8
narrative synthesis
8
competency-based medical
8
medical education
8
cbme
8
training programmes
8
outcomes cbme
8
cbme curriculum
8

Similar Publications

Objective:  The objectives of the study were to (i) evaluate the effectiveness of wideband absorbance (WBA) at ambient pressure (WBA), tympanic peak pressure (WBA), and 0 daPa (WBA) to identify conductive hearing loss (CHL) in infants and (ii) compare the sensitivity and specificity of the three WBA tests with that of high-frequency tympanometry (HFT) and transient-evoked otoacoustic emissions (TEOAE).

Method:  A total of 31 ears with hearing thresholds no greater than 20 dB HL (reference group from 20 infants [mean age: 3.1 weeks]) and 47 ears with CHL from 31 infants (mean age: 3.

View Article and Find Full Text PDF

Background: Workplace-based assessment (WBA) can facilitate evaluation of operative performance; however, implementation of WBA is sometimes unsuccessful. The American Board of Surgery Entrustable Professional Activities WBA project was launched in July 2023. Some programs will face the challenge of re-implementation of a WBA following previous failures.

View Article and Find Full Text PDF

How Reliable are Single-Question Workplace-Based Assessments in Surgery?

J Surg Educ

July 2024

Center for Surgical Training and Research, Department of Surgery, University of Michigan 010-A193, North Campus Research Complex 2800, Plymouth Road Ann Arbor, Michigan 48109.

Article Synopsis
  • The study evaluates inter-rater reliability of workplace-based assessments (WBAs) used to measure surgical trainees' performance, which is crucial as multiple faculty members assess the same residents.
  • Nine faculty members rated surgical residents' videos during operations using several scales, with findings showing low to moderate reliability across these assessments, indicated by intraclass correlation coefficients ranging from 0.33 to 0.47.
  • The research suggests that while training faculty could enhance consistency, a higher volume of assessments from different raters is necessary to accurately evaluate trainee performance over time.
View Article and Find Full Text PDF

Background: Workplace-based assessment (WBA) used in post-graduate medical education relies on physician supervisors' feedback. However, in a training environment where supervisors are unavailable to assess certain aspects of a resident's performance, nurses are well-positioned to do so. The Ottawa Resident Observation Form for Nurses (O-RON) was developed to capture nurses' assessment of trainee performance and results have demonstrated strong evidence for validity in Orthopedic Surgery.

View Article and Find Full Text PDF

Objectives: The purpose of this educational intervention was to introduce, iteratively adapt, and implement a digital formative assessment tool in a surgical speciality. The study also evaluated the intervention's impact on perioperative teaching, learning, feedback, and surgical competency.

Design: A participatory action research model with a mixed methods approach.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!