Context: Achieving competence in 'practice-based learning' implies that doctors can accurately self- assess their clinical skills to identify behaviours that need improvement. This study examines the impact of receiving feedback via performance benchmarks on medical students' self-assessment after a clinical performance examination (CPX).

Methods: The authors developed a practice-based learning exercise at 3 institutions following a required 8-station CPX for medical students at the end of Year 3. Standardised patients (SPs) scored students after each station using checklists developed by experts. Students assessed their own performance immediately after the CPX (Phase 1). One month later, students watched their videotaped performance and reassessed (Phase 2). Some students received performance benchmarks (their scores, plus normative class data) before the video review. Pearson's correlations between self-ratings and SP ratings were calculated for overall performance and specific skill areas (history taking, physical examination, doctor-patient communication) for Phase 1 and Phase 2. The 2 correlations were then compared for each student group (i.e. those who received and those who did not receive feedback).

Results: A total of 280 students completed both study phases. Mean CPX scores ranged from 51% to 71% of items correct overall and for each skill area. Phase 1 self-assessment correlated weakly with SP ratings of student performance (r = 0.01-0.16). Without feedback, Phase 2 correlations remained weak (r = 0.13-0.18; n = 109). With feedback, Phase 2 correlations improved significantly (r = 0.26-0.47; n = 171). Low-performing students showed the greatest improvement after receiving feedback.

Conclusions: The accuracy of student self-assessment was poor after a CPX, but improved significantly with performance feedback (scores and benchmarks). Videotape review alone (without feedback) did not improve self-assessment accuracy. Practice-based learning exercises that incorporate feedback to medical students hold promise to improve self-assessment skills.

Download full-text PDF

Source
http://dx.doi.org/10.1111/j.1365-2923.2007.02818.xDOI Listing

Publication Analysis

Top Keywords

practice-based learning
12
medical students
12
phase correlations
12
students
9
performance
9
clinical performance
8
performance examination
8
performance benchmarks
8
feedback phase
8
improve self-assessment
8

Similar Publications

Building Family Medicine Research Through Community Engagement: Leveraging Federal Awards to Develop Infrastructure.

J Am Board Fam Med

January 2025

From the Department of Family Medicine and Community Health, Rutgers Health, 303 George Street, Matrix Plaza 1, Room 614, New Brunswick, NJ (AFT, JMF, MEJ, MP, MFC, EJ, SVH); New Jersey Alliance for Clinical and Translational Science, New Brunswick, NJ (AFT, DH, MEJ, SVH); Office of University-Community Partnerships, Rutgers University, Newark, NJ (DH); Department of Pediatrics, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ (MEJ); Rutgers Robert Wood Johnson Medical School, Rutgers Institute for Translational Medicine and Science, New Brunswick, NJ, USA (SVH).

Many academic departments and programs struggle with the challenge of how to begin a meaningful research program. A useful place to start is with the work they already are doing in communities. Using work in practices and other clinical venues as a springboard can build helpful relationships that can catalyze research and build infrastructure that matters to family medicine clinicians, researchers, and the communities they serve.

View Article and Find Full Text PDF

Background: Unhealthy alcohol use is a leading cause of preventable mortality and a risk factor for an array of social and health problems. The Intervention in Small primary care Practices to Implement Reduction in unhealthy alcohol use (INSPIRE) study is part of a nationwide campaign to improve the identification and treatment of patients engaging in unhealthy alcohol use.

Methods: We conducted a single arm, pragmatic study consisting of seventeen primary care practices in the Chicago metropolitan area, Wisconsin, and California across two waves with a 6-month latent period, a 12-month intervention period, followed by a 6-month sustainability period.

View Article and Find Full Text PDF

Sustainable poultry education for undergraduate students.

Poult Sci

December 2024

Department of Poultry Science, University of Arkansas, Fayetteville, AR, United States.

Sustainable poultry production can help address many critical socio- and environmental issues, including food insecurity, climate crisis, and loss of biodiversity. The education of undergraduate students in poultry science helps prepare a future workforce in poultry production and to develop responsible citizens for global engagement. The University of Connecticut has a poultry project, funded by U.

View Article and Find Full Text PDF

Introduction: The stakeholder analysis approach has historically been top-down rather than collaborative with key partners. However, this approach poses challenges for key partner engagement and community-engaged research, which aims to incorporate key partners throughout the project. This study, conducted by the Community Engagement Network at a Midwest Academic Medical Center, seeks to examine the value of community-engaged research for diverse key partners to increase collaboration, strengthen partnerships, and enhance impact, ultimately driving key partner engagement.

View Article and Find Full Text PDF

AI Thinking: a framework for rethinking artificial intelligence in practice.

R Soc Open Sci

January 2025

Centre for Machine Intelligence, The University of Sheffield, Sheffield S1 3JD, UK.

Artificial intelligence is transforming the way we work with information across disciplines and practical contexts. A growing range of disciplines are now involved in studying, developing and assessing the use of AI in practice, but these disciplines often employ conflicting understandings of what AI is and what is involved in its use. New, interdisciplinary approaches are needed to bridge competing conceptualizations of AI in practice and help shape the future of AI use.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!