Background: The Accreditation Council for Graduate Medical Education Milestone Project was implemented in 2014 to standardize assessments and progression of residents. While it is recommended that milestones not be used as tools for direct assessments of resident competency, many programs have used or adapted milestone tools for this purpose.

Objective: We sought to explore use of the most frequent milestone level at which a resident was evaluated (ie, the mode), and compared this to the standard practice of using the arithmetic mean for summarizing performance.

Methods: We reviewed all Family Medicine Milestone evaluations from 1 program for the first 2 academic years of milestone implementation. Mean and mode scores were calculated across 24 unique residents, 841 evaluation forms, and 5897 measurements. The proportion of overestimation errors (where the mean is at least 0.5 larger than the mode) and underestimation errors (where the mean is at least 0.5 less than the mode) were then compared across resident training year and subcompetency.

Results: For the 24 residents, an estimation error occurred in 175 of 792 of the comparisons (22%). Of these errors, 118 (67%) were overestimation errors. First-year residents accounted for 55% (96 of 175) of all estimation errors. All subcompetencies had some estimation errors, with 6 having greater than 5%.

Conclusions: If the trend for using the milestones as stand-alone assessment tools is to continue, aggregating data by using frequency distributions and mode would be a more stable and appropriate approach given their nominal or, at best, ordinal nature.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5476378PMC
http://dx.doi.org/10.4300/JGME-D-16-00571.1DOI Listing

Publication Analysis

Top Keywords

resident competency
8
mode compared
8
overestimation errors
8
estimation errors
8
mode
6
errors
6
milestone
5
impact versus
4
versus mode
4
mode assessing
4

Similar Publications

High flow nasal cannula (HFNC) can reduce the need for intubation in patients with coronavirus disease-19 (COVID-19) pneumonia induced acute hypoxemic respiratory failure (AHRF), but predictors of HFNC success could be characterized better. C-reactive protein (CRP) and D-dimer are associated with COVID-19 severity and progression. However, no one has evaluated the use of serial CRP and D-dimer ratios to predict HFNC success.

View Article and Find Full Text PDF

Introduction: Ultrasound is important in heart diagnostics, yet implementing effective cardiac ultrasound requires training. While current strategies incorporate digital learning and ultrasound simulators, the effectiveness of these simulators for learning remains uncertain. This study evaluates the effectiveness of simulator-based versus human-based training in Focused Assessed with Transthoracic Echocardiography (FATE).

View Article and Find Full Text PDF

Objectives: The main objective of this study was to evaluate whether the implementation of CoBaTrICE (Competency-Based Training in Intensive Care Medicine in Europe) provides higher levels of competency in comparison with the current official time-based program in Intensive Care Medicine in Spain. Secondary objectives were: 1) To determine the percentage of critical essential performance elements (CEPE) accomplished, 2) To determine compliance with workplace-based assessments (wba).

Design: Multicenter cluster randomized trial.

View Article and Find Full Text PDF

This study used Raman and near-infrared (NIR) spectroscopy to monitor small real-time changes in powder blends and tablets in low-dose pharmaceutical formulations. The research aims to enhance process analytical technology (PAT) in pharmaceutical manufacturing, ensuring high-quality and uniform products with applications to produce drugs with narrow therapeutic indices (NTI). The study utilizes Raman and NIR spatially resolved spectroscopy (SRS) techniques to monitor a moderate cohesive material's active pharmaceutical ingredient (API) concentrations during manufacturing.

View Article and Find Full Text PDF

Face pareidolia minimally engages macaque face selective neurons.

Prog Neurobiol

January 2025

Section on Cognitive Neurophysiology and Imaging, National Institute of Mental Health; Bethesda, MD, USA; Neurophysiology Imaging Facility, National Institute of Mental Health, National Institute of Neurological Disorders and Stroke, National Eye Institute; Bethesda, MD, USA. Electronic address:

The macaque cerebral cortex contains concentrations of neurons that prefer faces over inanimate objects. Although these so-called face patches are thought to be specialized for the analysis of facial signals, their exact tuning properties remain unclear. For example, what happens when an object by chance resembles a face? Everyday objects can sometimes, through the accidental positioning of their internal components, appear as faces.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!