Summative assessments are often underused for feedback, despite them being rich with data of students' applied knowledge and clinical and professional skills. To better inform teaching and student support, this study aims to gain insights from summative assessments through profiling students' performance patterns and identify those students missing the basic knowledge and skills in medical specialities essential for their future career. We use Latent Profile Analysis to classify a senior undergraduate year group (n = 295) based on their performance in applied knowledge test (AKT) and OSCE, in which items and stations are pre-classified across five specialities (e.g. Acute and Critical Care, Paediatrics,…). Four distinct groups of students with increasing average performance levels in the AKT, and three such groups in the OSCE are identified. Overall, these two classifications are positively correlated. However, some students do well in one assessment format but not in the other. Importantly, in both the AKT and the OSCE there is a mixed group containing students who have met the required standard to pass, and those who have not. This suggests that a conception of a borderline group at the exam-level can be overly simplistic. There is little literature relating AKT and OSCE performance in this way, and the paper discusses how our analysis gives placement tutors key insights into providing tailored support for distinct student groups needing remediation. It also gives additional information to assessment writers about the performance and difficulty of their assessment items/stations, and to wider faculty about student overall performance and across specialities.

Download full-text PDF

Source
http://dx.doi.org/10.1007/s10459-024-10357-9DOI Listing

Publication Analysis

Top Keywords

summative assessments
12
akt osce
12
latent profile
8
profile analysis
8
medical specialities
8
applied knowledge
8
performance
6
tailoring support
4
support summative
4
assessments latent
4

Similar Publications

Although social determinants of health (SDoH) investigations have shown limited analyses of socioeconomic and race-ethnic status on certain hematologic malignancies, the impact of factors beyond those across a fuller scope of hematologic cancers remains unknown. The Social Vulnerability Index (SVI), a tool for assessing varied US-census derived sociodemographic factors, allows the specific quantification of SDoH in dynamic, regional contexts for their associations with hematologic-malignancy inequities. To assess the summative influence of varied SDoH-factors on hematologic malignancy outcomes and discern which SDoH-factors contributed the largest associations towards disparities 796,005 adults with hematologic malignancies between 1975-2017 were identified for this retrospective cohort study.

View Article and Find Full Text PDF

This paper discusses the evolution of assessment for learning (AfL) across the globe with particular attention given to Western educational jurisdictions. Scholars from Australia, Canada, Ireland, Israel, New Zealand, Norway, and the United States discuss prominent assessment reforms within their respective countries over the last decade. Particular attention is given to the impact of the pandemic as well as technological developments for classroom assessment policies and practices.

View Article and Find Full Text PDF

The impact of summative, formative or programmatic assessment on the Dutch National Pharmacotherapy Assessment: a retrospective multicentre study.

Eur J Pharmacol

January 2025

Amsterdam UMC, location VUmc, Department of Internal Medicine, section Pharmacotherapy, Amsterdam, Netherlands; Research and Expertise Centre in Pharmacotherapy Education (RECIPE), Amsterdam, The Netherlands; Interprofessional Collaboration and Medication Safety at the Faculty of Health, Sports and Social Work, Inholland University of Applied Sciences, Amsterdam The Netherlands; Amsterdam Public Health, Quality of Care, Amsterdam, The Netherlands.

Background: The Dutch National Pharmacotherapy Assessment (DNPA), which focuses on assessing medication safety and essential drug knowledge, was introduced to improve clinical pharmacology and therapeutics education in the Netherlands. This study investigated how the performance of final-year medical students on the DPNA was affected by the assessment programme (traditional with summative or formative assessment, and programmatic assessment).

Methods: This multicentre retrospective longitudinal observation study (2019-2023) involved final-year medical students from four medical schools in the Netherlands.

View Article and Find Full Text PDF

Measuring Residents' Competence in Chest Tube Insertion on Thiel-Embalmed Bodies: A Validity Study.

Simul Healthc

December 2024

From the Department of Human Structure and Repair, Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium (L.D.M., I.V.H., L.D., W.W.); Department of Thoracic and Vascular Surgery, Ghent University Hospital, Ghent, Belgium (I.V.H., L.D.); Department of Basic and Applied Medical Sciences, Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium (P.V.d.V.); Department of Emergency Medicine, Ghent University Hospital, Ghent, Belgium (P.V.d.V.); Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium (H.V., W.W.); Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark (L.K.); and Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark (L.K.).

Introduction: Chest tube insertions (CTIs) have a high complication rate, prompting the training of technical skills in simulated settings. However, assessment tools require validity evidence prior to their implementation. This study aimed to collect validity evidence for assessment of technical skills in CTI on Thiel-embalmed human bodies.

View Article and Find Full Text PDF

A mixed method approach to substantiate quantitative data with qualitative data: Improving clinical judgment in prelicensure nursing students using simulation.

Nurse Educ Today

January 2025

University of Washington, United States; Capella University, United States; Bellevue College, United States; Marymount University, Arlington, VA, United States; University of Texas Health Science Center at Houston, United States. Electronic address:

Background: Current literature demonstrates a gap in research involving mixed method study of clinical judgment development in prelicensure nursing students.

Objectives: Clinical judgment of two groups of nursing students were compared using the Lasater Clinical Judgment Rubric (LCJR).

Design: A mixed method convergent parallel quasi-experimental cross-sectional approach was used to determine if simulation increased clinical judgment skills between beginner and advanced pre-licensure nursing students.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!