Background: Test evaluation in a clinical curriculum is important for medical education. To identify examinee ability and appropriateness of the test content, this study used the Rasch model to analyze an examination in anesthesiology for medical students.

Methods: Fifty items were administered to 119 fifth- and sixth-year medical students in the exam. The Rasch model was used to perform item analysis of the examination. Misfit items or examinees were excluded first, then test reliability was assessed with reliability indices. Both examinee ability measures and item difficulty were estimated and expressed in a common logit unit, which could be further translated into probability of correct responses in the examination.

Results: After the exclusion of two misfit items and one misfit examinee, the estimated test reliability was only 0.63. The mean item difficulty was set at 0 by definition (SD = 2.02) and the mean examinee ability was 1.56 (SD = 0.71), which means that the examinees were able to correctly answer 83% of items on average. There were 21 items with difficulty lower than the least able examinee and two items with difficulty higher than the most able one.

Conclusion: We demonstrated that statistical item analysis with the Rasch model could provide valuable information related to test reliability, item difficulty and examinee ability, which could be applied to further item modification and future test development of clinical curriculums for medical students.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.jcma.2011.01.027DOI Listing

Publication Analysis

Top Keywords

rasch model
16
examinee ability
16
item analysis
12
medical students
12
test reliability
12
item difficulty
12
statistical item
8
analysis examination
8
examination anesthesiology
8
anesthesiology medical
8

Similar Publications

Validating psychometric properties of generic quality-of-life instruments (WHOQOL-BREF (TW) and EQ-5D) among non-dialysis chronic kidney disease: Rasch and confirmatory factor analyses.

J Formos Med Assoc

January 2025

Division of Nephrology, Department of Internal Medicine, National Cheng Kung University Hospital, College of Medicine, National Cheng-Kung University, Tainan, Taiwan; Institute of Clinical Medicine, College of Medicine, National Cheng Kung University, Tainan, Taiwan. Electronic address:

Background: Quality of life (QOL) is important for evaluating medical care outcomes. In chronic kidney disease (CKD) population, generic instruments, such as WHOQOL-BREF and EQ-5D, are commonly used for comparing various medical conditions for policy-making purposes. However, their psychometric properties have not yet been validated in non-dialysis CKD population.

View Article and Find Full Text PDF

Assessment of pandemic-related pregnancy stress from seven western countries using Rasch analyses.

J Psychiatr Res

December 2024

Instituto de Investigación Biosanitaria Ibs.GRANADA, Granada, Spain; Faculty of Health Sciences, Department of Nursing, University of Granada (Spain), 04120 Almería, Spain. Electronic address:

Introduction: This study examined psychometric properties of the Pandemic-Related Pregnancy Stress Scale (PREPS) using a Rasch Model (RM) in a large sample of pregnant women from Germany, Israel, Italy, Poland, Spain, Switzerland and the United States of America (USA).

Material And Methods: Rasch analyses were used to analyze a sample of 7185 pregnant women who completed the PREPS during the COVID-19 pandemic onset from April to August 2020. Psychological, sociodemographic, and obstetric factors were also collected and analyzed.

View Article and Find Full Text PDF

Introduction: The Person-Centred Care instrument for outpatient care (PCCoc) is a 36-item patient-reported experience measure with 4 ordered response categories, that aims to capture the degree of perceived person-centred care (PCC) from a patient perspective among persons with long-term conditions. The PCCoc is based on a framework that conceptualises outpatient PCC from lower to higher levels of perceived PCC, from personalisation via shared decision-making to empowerment, where 35 of the PCCoc items are a part of the framework's hierarchy.

Aim: To investigate to what extent empirical item responses are consistent with the hierarchical PCCoc conceptual framework among persons with long-term conditions in outpatient care.

View Article and Find Full Text PDF

Background: The increasing global prevalence of asthma necessitates effective disease management, with patients and their families playing a central role. Enhancing health literacy (HL) among caregivers is critical to improving asthma outcomes.

Purpose: This study aimed to validate the Arabic version of the Asthma Numeracy Questionnaire (Ar-ANQ) to address the gap in HL assessment tools for Arabic-speaking populations.

View Article and Find Full Text PDF

Translation and validation of the 8-item contact lens dry eye questionnaire (CLDEQ-8) among Chinese soft contact lens wearers.

Cont Lens Anterior Eye

January 2025

State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangzhou, China. Electronic address:

Purpose: To develop a Chinese version of the 8-item Contact Lens Dry Eye Questionnaire (CLDEQ-8) with cross-cultural adaption and clinical validation among soft contact lens wearers (SCL) in China.

Methods: The translation and adaptation of the Chinese CLDEQ-8 (C-CLDEQ-8) followed a rigorous methodological process based on cross-cultural research guidelines consisting of three main phases: 1) forward and backward translation of original CLDEQ-8 into Chinese, 2) cross-cultural adaptation performed by medical advising committee, and 3) clinical validation and repeatability test of the translated questionnaire on Chinese SCL wearers. Rasch analysis was also performed to investigate the psychometric properties of C-CLDEQ-8.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!