Background: Use of EPA-based entrustment-supervision ratings to determine a learner's readiness to assume patient care responsibilities is expanding.
Objective: In this study, we investigate the correlation between narrative comments and supervision ratings assigned during ad hoc assessments of medical students' performance of EPA tasks.
Design: Data from assessments completed for students enrolled in the clerkship phase over 2 academic years were used to extract a stratified random sample of 100 narrative comments for review by an expert panel.
Participants: A review panel, comprised of faculty with specific expertise related to their roles within the EPA program, provided a "gold standard" supervision rating using the comments provided by the original assessor.
Main Measures: Interrater reliability (IRR) between members of review panel and correlation coefficients (CC) between expert ratings and supervision ratings from original assessors.
Key Results: IRR among members of the expert panel ranged from .536 for comments associated with focused history taking to .833 for complete physical exam. CC (Kendall's correlation coefficient W) between panel members' assignment of supervision ratings and the ratings provided by the original assessors for history taking, physical examination, and oral presentation comments were .668, .697, and .735 respectively. The supervision ratings of the expert panel had the highest degree of correlation with ratings provided during assessments done by master assessors, faculty trained to assess students across clinical contexts. Correlation between supervision ratings provided with the narrative comments at the time of observation and supervision ratings assigned by the expert panel differed by clinical discipline, perhaps reflecting the value placed on, and perhaps the comfort level with, assessment of the task in a given specialty.
Conclusions: To realize the full educational and catalytic effect of EPA assessments, assessors must apply established performance expectations and provide high-quality narrative comments aligned with the criteria.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9296736 | PMC |
| http://dx.doi.org/10.1007/s11606-022-07509-1 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Supplemental Intervention for Alcohol Use Disorder Treatment Patients With a Co-Occurring Anxiety Disorder: Technical Development and Functional Testing of an Autonomous Digital Program.
JMIR Form Res
December 2024
Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States.
Background: Anxiety disorders are common in alcohol use disorder (AUD) treatment patients. Such co-occurring conditions ("comorbidity") have negative prognostic implications for AUD treatment outcomes, yet they commonly go unaddressed in standard AUD care. Over a decade ago, we developed and validated a cognitive behavioral therapy intervention to supplement standard AUD care that, when delivered by trained therapists, improves outcomes in comorbid patients.
View Article and Find Full Text PDFExploring the potential of introducing an electronic death registration system in South Africa.
Health Res Policy Syst
December 2024
South African Medical Research Council, Cape Town, South Africa.
Background: Despite South Africa's well-established Civil Registration and Vital Statistics system (CRVS) and good completeness of death registration, challenges persist in terms of the quality of cause of death information and the delayed availability of mortality statistics. The introduction of an electronic medical certification of cause of death (eMCCD) system may offer opportunities to improve both the quality and timeliness of this information.
Methods: This study used an exploratory mixed methods design to investigate perceptions surrounding an electronic solution for registering deaths in South Africa.
A machine learning model to predict the risk factors causing feelings of burnout and emotional exhaustion amongst nursing staff in South Africa.
BMC Health Serv Res
December 2024
NuMIQ Research Focus Area, School of Nursing Science, North-West University, 11 Hoffman Street, Potchefstroom, South Africa.
Background: The demand for quality healthcare is rising worldwide, and nurses in South Africa are under pressure to provide care with limited resources. This demanding work environment leads to burnout and exhaustion among nurses. Understanding the specific factors leading to these issues is critical for adequately supporting nurses and informing policymakers.
View Article and Find Full Text PDFPromoting trans patient autonomy in surgical preparation for phalloplasty and metoidioplasty: results from a community-based cross-sectional survey and implications for preoperative assessments.
BMC Med Ethics
December 2024
School of Public Health and Social Policy, Faculty of Human and Social Development, University of Victoria, Victoria, BC, Canada.
Background: Some transgender and nonbinary people undergo phalloplasty and/or metoidioplasty as part of their medical transition process. Across surgical disciplines, a variety of resources are used to assist patients who are preparing for surgeries, including educational materials, workshops, peer support, and lifestyle changes. For gender-affirming surgeries, patients undergoing assessments to discern whether they are ready to undergo the surgery, and to assist them in achieving preparedness when needed.
View Article and Find Full Text PDFGPs' perspectives on care models integrating medical and non-medical services in primary care-a representative survey in Germany.
BMC Prim Care
December 2024
Charité - Universitätsmedizin Berlin, Institute of General Practice and Family Medicine, Charitéplatz 1, Berlin, 10117, Germany.
Background: Health-related social problems are common in primary care. Different care models integrating medical and non-medical services in primary care have been tested and established nationally and internationally, such as social prescribing, social work in primary care, health kiosks and integrated primary care centres. The aim of our study was to explore the perspective of general practitioners (GPs) working in Germany on these four care models regarding their meaningfulness and if they would like to use them.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!