Background: When ratings of student performance within the clerkship consist of a variable number of ratings per clinical teacher (rater), an important measurement question arises regarding how to combine such ratings to accurately summarize performance. As previous G studies have not estimated the independent influence of occasion and rater facets in observational ratings within the clinic, this study was designed to provide estimates of these two sources of error.
Method: During 2 years of an emergency medicine clerkship at a large midwestern university, 592 students were evaluated an average of 15.9 times. Ratings were performed at the end of clinical shifts, and students often received multiple ratings from the same rater. A completely nested G study model (occasion: rater: person) was used to analyze sampled rating data.
Results: The variance component (VC) related to occasion was small relative to the VC associated with rater. The D study clearly demonstrates that having a preceptor rate a student on multiple occasions does not substantially enhance the reliability of a clerkship performance summary score.
Conclusions: Although further research is needed, it is clear that case-specific factors do not explain the low correlation between ratings and that having one or two raters repeatedly rate a student on different occasions/cases is unlikely to yield a reliable mean score. This research suggests that it may be more efficient to have a preceptor rate a student just once. However, when multiple ratings from a single preceptor are available for a student, it is recommended that a mean of the preceptor's ratings be used to calculate the student's overall mean performance score.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4770864 | PMC |
| http://dx.doi.org/10.3402/meo.v21.29279 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
The Impact of the COVID-19 Public Health Crisis on the Surgical Management of Abdominal Aortic Aneurysm Rupture.
Ann Vasc Surg
December 2024
Section of Vascular Surgery, Department of Surgery, Michigan Medicine, Ann Arbor, MI; Jobst Vascular Institute, Toledo, OH.
Objectives: The COVID-19 epidemic introduced significant systems- and disease-based uncertainty into Abdominal Aortic Aneurysm (AAA) rupture management. The goal of this work was to evaluate whether short-term AAA rupture outcomes during COVID-19 were comparable to pre-COVID era outcomes and to explore the impact of COVID status and COVID era healthcare systems restrictions on AAA rupture outcomes.
Methods: The Vascular Quality Initiative (VQI) database was queried for all ruptured AAAs that underwent intervention from January 1, 2019 to August 31, 2022.
Nerve dissection technique for excision of parotid tumors: Outcomes controlling for tumor size and location.
Am J Otolaryngol
December 2024
Department of Otolaryngology - Head & Neck Surgery, University of Michigan, Ann Arbor, MI, USA. Electronic address:
Purpose: We examined operative efficiency, rate of facial nerve paresis, and post-operative outcomes in patients undergoing retrograde (RGD) vs anterograde dissection (AGD) of the facial nerve controlling for tumor location.
Methods: Single-institution, retrospective analysis of patients with benign parotid tumors undergoing superficial parotidectomy with facial nerve dissection over a six-year period. Operative and pathology reports were reviewed to classify tumor size, location in relation to facial nerve branches, and technique for facial nerve dissection.
Designing a summative assessment blueprint in community medicine: an expert consensus approach at All India Institute of Medical Sciences.
BMC Med Educ
December 2024
Department of Community and Family Medicine, All India Institute of Medical Sciences, Patna, India.
Background: Despite the increasing integration of competency-based education in medicine, there remains a significant gap in effectively assessing educational outcomes, underscoring the urgent need for designed assessment blueprints that accurately reflect both curriculum content and competency standards in Community Medicine for undergraduate students. This study, conducted across the All-India Institute of Medical Sciences (AIIMS) network, develops a summative assessment blueprint aimed at standardizing evaluations in medical education across diverse geographic locations in India.
Methods: Twenty-five experts from 10 All India Institutes of Medical Science were invited via email and contributed for summative assessment for a theory paper.
Luliconazole-loaded nanostructured lipid carrier: formulation, characterization, and in vitro antifungal evaluation against a panel of resistant fungal strains.
Sci Rep
December 2024
Department of Pharmaceutics, Faculty of Pharmacy, Mazandaran University of Medical Sciences, PO Box. 48175-1665, Sari, Iran.
Luliconazole (LCZ) is a topical imidazole antifungal agent with broad-spectrum activity. However, LCZ encounters challenges such as low aqueous solubility, skin retention, and penetration, which reduce its dermal bioavailability and hinder its efficacy in drug delivery. The aim of the present study was to formulate, characterize, and evaluate the in vitro antifungal efficacy of luliconazole-loaded nanostructured lipid carriers (LCZ-NLCs) against a panel of resistant fungal strains.
View Article and Find Full Text PDFNatural Drugs: Trends, Properties, and Decline in FDA Approvals.
J Pharm Sci
December 2024
Roseman University of Health Sciences, College of Pharmacy, 10920 South River Front Parkway, South Jordan, UT 84095, USA. Electronic address:
The purpose of this review is to better characterize the contribution and properties of FDA-approved drugs that can be found unmodified in nature. Defined inclusion criteria were applied to drugs identified in previous studies and in annual FDA approval reports to compile a comprehensive list of approved drugs found in nature. Databases and scientific literature were searched to identify chemical and drug properties of these entities, including chemical classes, approval years, drug indications, and approved delivery methods.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!