A study of Two Clinical Performance Scores: Assessing the Psychometric Characteristics of a Combined Score Derived from Clinical Evaluation Forms and OSCEs.

Med Educ Online

b Department of Family Medicine, Performance Based Assessment Program, Office of Student Affairs and Curriculum Carver College of Medicine, The University of Iowa Iowa City, Iowa , USA.

Published: December 2007

Background/Purpose - It is important to improve the quality of clinical skill assessments. In addition to using the OSCE, the clinical skills of medical students are assessed with clinical evaluation forms (CEFs). The purpose of this study is to examine the psychometric characteristics of an OSCE/CEF composite score. Methods - This study included 2 medical student classes from a large medical school. Students completed approximately 12 OSCEs and were rated over 33 times on a CEF. The reliability of the CEF and OSCE were estimated. A correlation between the mean OSCE score and the mean CEF was calculated and corrected for attenuation. Classical methods were used to examine composite score reliability. Results - For both classes there was a statistically significant correlation between the CEF and OSCE (r = .27 & .42, p = .003 & .0001). The disattenuated correlations were .44 and .68. Weighting the OSCE in the composite score as high as .4 was associated with only a small decrease in composite reliability. Conclusion - These results demonstrate that assessment information based on simulated and actual patient encounters can be combined into a composite. Since a composite score may provide a more valid measure of clinical performance, this study supports using a combined CEF and OSCE measure.

Download full-text PDF

Source
http://dx.doi.org/10.3402/meo.v12i.4466DOI Listing

Publication Analysis

Top Keywords

composite score
16
cef osce
12
clinical performance
8
psychometric characteristics
8
clinical evaluation
8
evaluation forms
8
score
6
osce
6
composite
6
clinical
5

Similar Publications

Although social determinants of health (SDoH) investigations have shown limited analyses of socioeconomic and race-ethnic status on certain hematologic malignancies, the impact of factors beyond those across a fuller scope of hematologic cancers remains unknown. The Social Vulnerability Index (SVI), a tool for assessing varied US-census derived sociodemographic factors, allows the specific quantification of SDoH in dynamic, regional contexts for their associations with hematologic-malignancy inequities. To assess the summative influence of varied SDoH-factors on hematologic malignancy outcomes and discern which SDoH-factors contributed the largest associations towards disparities 796,005 adults with hematologic malignancies between 1975-2017 were identified for this retrospective cohort study.

View Article and Find Full Text PDF

A Machine Learning Model Using Cardiac CT and MRI Data Predicts Cardiovascular Events in Obstructive Coronary Artery Disease.

Radiology

January 2025

From the Department of Cardiology (T.P., K.H., T.G., A.L., E.G., A.U., J.G.D., P.H.), MIRACL.ai (Multimodality Imaging for Research and Analysis Core Laboratory: and Artificial Intelligence) (T.P., S.T., K.H., T.G., A.L., E.G., A.U., J.G.D., P.H.), Inserm MASCOT-UMRS 942 (T.P., K.H., T.A.S., T.G., A.L., E.G., A.U., J.G.D., P.H.), and Department of Radiology (T.P., V.B., L.H., T.G.), Université Paris Cité, University Hospital of Lariboisière, Assistance Publique-Hôpitaux de Paris, Paris, France; Cardiovascular Magnetic Resonance Laboratory (T.P., T.H., T.U., F.S., S.C., P.G., J.G.) and Cardiac Computed Tomography Laboratory (T.P., T.H., T.L., B.C., T.U., F.S., S.C., H.B., A.N., M.A., P.G., J.G.), Hôpital Privé Jacques Cartier, Institut Cardiovasculaire Paris Sud, Ramsay Santé, 6 Avenue du Noyer Lambert, 91300 Massy, France; Scientific Partnerships, Siemens Healthcare France, Saint-Denis, France (S.T.); Department of Cardiology, Hôpital Universitaire de Bruxelles-Hôpital Erasme, Brussels, Belgium (A.U.); and Department of Cardiovascular Imaging, American Hospital of Paris, Neuilly, France (O.V., M.S.).

Background Multimodality imaging is essential for personalized prognostic stratification in suspected coronary artery disease (CAD). Machine learning (ML) methods can help address this complexity by incorporating a broader spectrum of variables. Purpose To investigate the performance of an ML model that uses both stress cardiac MRI and coronary CT angiography (CCTA) data to predict major adverse cardiovascular events (MACE) in patients with newly diagnosed CAD.

View Article and Find Full Text PDF

Operating on the Oldest-Old: Vaginal Prolapse Surgery Outcomes in Women Over 90.

Urogynecology (Phila)

January 2025

Division of Urogynecology and Reconstructive Pelvic Surgery, Department of Obstetrics and Gynecology, University of Pittsburgh Medical Center, Pittsburgh, PA.

Importance: Women aged 90 years and older ("oldest-old") represent a small but growing population who may experience bothersome pelvic organ prolapse and opt for surgical repair.

Objective: This study aimed to compare perioperative adverse events (AEs) within 8 weeks of prolapse surgery between women ≥90 years and younger patients.

Study Design: We performed a secondary analysis of a dual-center retrospective cohort study of women ≥61 years old undergoing major prolapse surgery from January 2016 to May 2023.

View Article and Find Full Text PDF

Low-grade gliomas and reactive piloid gliosis can present with overlapping features on conventional histology. Given the large implications for patient treatment, there is a need for effective methods to discriminate these morphologically similar but clinically distinct entities. Using routinely available stains, we hypothesize that a limited panel including SOX10, p16, and cyclin D1 may be useful in differentiating mitogen-activated protein (MAP) kinase-activated low-grade gliomas from piloid gliosis.

View Article and Find Full Text PDF

Severity of metabolic derangement predicts survival after out-of-hospital cardiac arrest and the likelihood of benefiting from extracorporeal life support.

Emergencias

December 2024

Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seúl, República de Corea. Department of Digital Health, SAIHST, Sungkyunkwan University, Seúl, República de Corea.

Objective: To develop a Metabolic Derangement Score (MDS) based on parameters available after initial testing and assess the score's ability to predict survival after out-of hospital cardiac arrest (OHCA) and the likely usefulness of extracorporeal life support (ECLS).

Methods: A total of 5100 cases in the Korean Cardiac Arrest Research Consortium registry were included. Patients' mean age was 67 years, and 69% were men.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!