The ratings that judges or examiners use for determining pass marks and students' performance on OSCEs serve a number of essential functions in medical education assessment, and their validity is a pivotal issue. However, some types of errors often occur in ratings that require special efforts to minimise. Rater characteristics (e.g. generosity error, severity error, central tendency error or halo error) may present a source of performance irrelevant variance. Prior literature shows the fundamental problems in student performance measurement attached to judges' or examiners' errors. It also indicates that the control of such errors supports a robust and credible pass mark and thus, accurate student marks. Therefore, for a standard-setter who identifies the pass mark and an examiner who rates student performance in OSCEs, proper, user-friendly feedback on their standard-setting and ratings is essential for reducing bias. This feedback provides useful avenues for understanding why performance ratings may be irregular and how to improve the quality of ratings. This AMEE Guide discusses various methods of feedback to support examiners' understanding of the performance of students and the standard-setting process with an effort to make inferences from assessments fair, valid and reliable.

Download full-text PDF

Source
http://dx.doi.org/10.1080/0142159X.2021.1993164DOI Listing

Publication Analysis

Top Keywords

feedback support
8
support examiners'
8
examiners' understanding
8
standard-setting process
8
performance students
8
amee guide
8
performance osces
8
student performance
8
pass mark
8
understanding performance
8

Similar Publications

Different whole-brain computational models have been recently developed to investigate hypotheses related to brain mechanisms. Among these, the Dynamic Mean Field (DMF) model is particularly attractive, combining a biophysically realistic model that is scaled up via a mean-field approach and multimodal imaging data. However, an important barrier to the widespread usage of the DMF model is that current implementations are computationally expensive, supporting only simulations on brain parcellations that consider less than 100 brain regions.

View Article and Find Full Text PDF

Introduction Transitioning from a medical student to a foundation doctor presents numerous challenges, particularly in managing on-call duties that require quick decision-making, clinical skills, and prioritisation under pressure. The Simulation On-Call (SOC) program was developed as a one-day, immersive simulation event to equip final-year medical students with the skills and confidence needed for these responsibilities. Methods The SOC program is an annual event held for final-year medical students at the Royal Blackburn Hospital, Blackburn, UK.

View Article and Find Full Text PDF

Background First-year medical students may find it challenging to integrate complex physiological concepts, particularly neuromuscular physiology. While concept mapping has shown promise in medical education, its specific application in teaching intricate physiological mechanisms still needs to be explored. With this background, the objective of the study was to assess the feasibility of using concept mapping among first-year medical students and to explore the perception of students about concept mapping as an educational tool.

View Article and Find Full Text PDF

Delays in accessing chest drain equipment in the Emergency Department (ED) posed significant risks to patient safety, particularly for those with life-threatening pneumothorax. This quality improvement project (QIP) aimed to reduce these delays by implementing a dedicated chest drain trolley using the Plan-Do-Study-Act (PDSA) methodology. Surveys and simulations identified key issues, including equipment inaccessibility and staff unfamiliarity, with baseline preparation times exceeding 20 minutes.

View Article and Find Full Text PDF

Background: Blood pressure (BP) control following stroke is important but currently sub-optimal. This trial aimed to determine whether self-monitoring of hypertension with telemonitoring and a treatment escalation protocol, results in lower BP than usual care in people with previous stroke or transient ischaemic attack (TIA).

Methods: Unblinded randomised controlled trial, comparing a BP telemonitoring-based intervention with control (usual care) for hypertension management in 12 primary care practices in England.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!