Context: The objective structured clinical examination (OSCE) is comprised of a series of simulations used to assess the skill of medical practitioners in the diagnosis and treatment of patients. It is often used in high-stakes examinations and therefore it is important to assess its reliability and validity.
Methods: The published literature was searched (PsycINFO, PubMed) for OSCE reliability estimates (coefficient alpha and generalisability coefficients) computed either across stations or across items within stations. Coders independently recorded information about each study. A meta-analysis of the available literature was computed and sources of systematic variance in estimates were examined.
Results: A total of 188 alpha values from 39 studies were coded. The overall (summary) alpha across stations was 0.66 (95% confidence interval [CI] 0.62-0.70); the overall alpha within stations across items was 0.78 (95% CI 0.73-0.82). Better than average reliability was associated with a greater number of stations and a higher number of examiners per station. Interpersonal skills were evaluated less reliably across stations and more reliably within stations compared with clinical skills.
Conclusions: Overall scores on the OSCE are often not very reliable. It is more difficult to reliably assess communication skills than clinical skills when considering both as general traits that should apply across situations. It is generally helpful to use two examiners and large numbers of stations, but some OSCEs appear more reliable than others for reasons that are not yet fully understood.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1111/j.1365-2923.2011.04075.x | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Insights into NEK2 inhibitors as antitumor agents: From mechanisms to potential therapeutics.
Eur J Med Chem
January 2025
Department of Respiratory and Critical Care Medicine, Targeted Tracer Research and Development Laboratory, Institute of Respiratory Healthand, Department of Frontiers Science Center for Disease-related Molecular Network, Core Facilities, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China. Electronic address:
NEK2, a serine/threonine protein kinase, is integral to mitotic events such as centrosome duplication and separation, microtubule stabilization, spindle assembly checkpoint, and kinetochore attachment. However, NEK2 overexpression leads to centrosome amplification and chromosomal instability, which are significantly associated with various malignancies, including liver, breast, and non-small cell lung cancer. This overexpression could facilitate tumor development and confer resistance to therapy by promoting aberrant cell division and centrosome amplification.
View Article and Find Full Text PDFPsychological and Behavioral Insights From Social Media Users: Natural Language Processing-Based Quantitative Study on Mental Well-Being.
JMIR Form Res
January 2025
Smith School of Business, Queen's University, Kingston, ON, Canada.
Background: Depression significantly impacts an individual's thoughts, emotions, behaviors, and moods; this prevalent mental health condition affects millions globally. Traditional approaches to detecting and treating depression rely on questionnaires and personal interviews, which can be time consuming and potentially inefficient. As social media has permanently shifted the pattern of our daily communications, social media postings can offer new perspectives in understanding mental illness in individuals because they provide an unbiased exploration of their language use and behavioral patterns.
View Article and Find Full Text PDFAnalysis of "Dr Ding Xiang" on WeChat in China to Determine Factors Influencing Readership on Medical Social Media: Observational Study.
J Med Internet Res
January 2025
Department of Epidemiology, School of Public Health, Sun Yat-Sen University, Shenzhen, China.
Background: With the rapid expansion of social media platforms, the demand for health information has increased substantially, leading to innovative approaches and new opportunities in health education.
Objective: This study aims to analyze the characteristics of articles published on the "Dr Ding Xiang" WeChat official account (WOA), one of the most popular institutional accounts on the WeChat platform, to identify factors influencing readership engagement and to propose strategies for enhancing the effectiveness of health information dissemination.
Methods: A total of 5286 articles published on the "Dr Ding Xiang" WOA from January 2021 to December 2021 were collected and analyzed.
Using Community Engagement to Create a Telecoaching Intervention to Improve Self-Management in Adolescents and Young Adults With Cystic Fibrosis: Qualitative Study.
J Particip Med
January 2025
Division of Allergy & Pulmonary Medicine, Washington University School of Medicine, St Louis, MO, United States.
Background: Adolescents and young adults (AYA) with cystic fibrosis (CF) are at risk for deviating from their daily treatment regimen due to significant time burden, complicated daily therapies, and life stressors. Developing patient-centric, effective, engaging, and practical behavioral interventions is vital to help sustain therapeutically meaningful self-management.
Objective: This study aimed to devise and refine a patient-centered telecoaching intervention to foster self-management in AYA with CF using a combination of intervention development approaches, including an evidence- and theory-based approach (ie, applying existing theories and research evidence for behavior change) and a target population-centered approach (ie, intervention refinement based on the perspectives and actions of those individuals who will use it).
A deep learning tissue classifier based on differential Co-expression genes predicts the pregnancy outcomes of cattle.
Biol Reprod
January 2025
Inner Mongolia SK·Xing Animal Breeding and Breeding Biotechnology Research Institute Co., Ltd, Hohhot 011517, China.
Economic losses in cattle farms are frequently associated with failed pregnancies. Some studies found that the transcriptomic profiles of blood and endometrial tissues in cattle with varying pregnancy outcomes display discrepancies even before artificial insemination (AI) or embryo transfer (ET). In the study, 330 samples from seven distinct sources and two tissue types were integrated and divided into two groups based on the ability to establish and maintain pregnancy after AI or ET: P (pregnant) and NP (nonpregnant).
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!