Background: The literature is sparse on written test development in a post-graduate multi-disciplinary setting. Developing and evaluating knowledge tests for use in multi-disciplinary post-graduate training is challenging. The objective of this study was to describe the process of developing and evaluating a multiple-choice question (MCQ) test for use in a multi-disciplinary training program in obstetric-anesthesia emergencies.
Methods: A multi-disciplinary working committee with 12 members representing six professional healthcare groups and another 28 participants were involved. Recurrent revisions of the MCQ items were undertaken followed by a statistical analysis. The MCQ items were developed stepwise, including decisions on aims and content, followed by testing for face and content validity, construct validity, item-total correlation, and reliability.
Results: To obtain acceptable content validity, 40 out of originally 50 items were included in the final MCQ test. The MCQ test was able to distinguish between levels of competence, and good construct validity was indicated by a significant difference in the mean score between consultants and first-year trainees, as well as between first-year trainees and medical and midwifery students. Evaluation of the item-total correlation analysis in the 40 items set revealed that 11 items needed re-evaluation, four of which addressed content issues in local clinical guidelines. A Cronbach's alpha of 0.83 for reliability was found, which is acceptable.
Conclusion: Content and construct validity and reliability were acceptable. The presented template for the development of this MCQ test could be useful to others when developing knowledge tests and may enhance the overall quality of test development.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1111/aas.12428 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Prospective multi-centre analysis of rural trauma team development training for medical trainees and traffic law enforcement professionals in Uganda: an interrupted time series study.
BMC Med Educ
January 2025
Heidelberg Institute of Global Health (HIGH), University Hospital and University of Heidelberg, Heidelberg, Germany.
Background: Research shows that trauma team formation could potentially improve effectiveness of injury care in rural settings. The aim of this study was to determine the feasibility of rural trauma team training amongst medical trainees and traffic law enforcement professionals in Uganda.
Methods: Prospective multi-centre interrupted time series analysis of an interventional training based on the 4th edition of rural trauma team development course of the American College of Surgeons.
Effect of feedback-integrated reflection, on deep learning of undergraduate medical students in a clinical setting.
BMC Med Educ
January 2025
Riphah international university, Rawalpindi, Pakistan.
Background: Reflection fosters self-regulated learning by enabling learners to critically evaluate their performance, identify gaps, and make plans to improve. Feedback, in turn, provides external insights that complement reflection, helping learners recognize their strengths and weaknesses, adjust their learning strategies, and enhance clinical reasoning and decision-making skills. However, reflection alone may not produce the desirable effects unless coupled with feedback.
View Article and Find Full Text PDFScript Concordance Test in Physiology: Preparation, Scoring, and Student Perceptions - A Mixed Method Study.
Int J Appl Basic Med Res
November 2024
Director, Simulation Centre, Mahatma Gandhi Medical College Research Institute, Sri Balaji Vidyapeeth (Deemed to be University), Pondicherry - Cuddalore Road, Pillayarkuppam, Puducherry, India.
Background: Although the curriculum has changed, assessment tools are not in alignment with the new types of teaching such as early clinical exposure (ECE) and self-directed learning. Both in summative and formative assessment most commonly used tools for assessment of cognitive domain are written formats including MCQ. However, these assessment tools such as MCQ and written essays cannot assess the higher order thinking skills and clinical reasoning skills.
View Article and Find Full Text PDFJigsaw as a Revision Module for Enhancing Learning in Biochemistry Among First-Year Medical Students.
Cureus
November 2024
Department of Biochemistry, All India Institute of Medical Sciences, Punjab, IND.
Aim Biochemistry includes the elaborate study of various biomolecules and intricate mechanisms that first-year medical students find difficult to understand and retain when taught through didactic lectures. Therefore, this study aims to test the effectiveness of jigsaw as a revision module in increasing the knowledge and retention capacity of students in Biochemistry. Materials and methods Eighty students were enrolled in the study.
View Article and Find Full Text PDFThe battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions.
BMC Med Educ
December 2024
Department of Gastroenterology and Hepatology, Leiden University Medical Center, Albinusdreef 2, Leiden, 2333 ZA, The Netherlands.
Background: Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students' knowledge retention.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!