Objective: Automatic item generation (AIG) is a new area of assessment research where a set of multiple-choice questions (MCQs) are created using models and computer technology. Although successfully demonstrated in medicine and dentistry, AIG has not been implemented in pharmacy. The objective was to implement AIG to create a set of MCQs appropriate for inclusion in a summative, high-stakes, pharmacy examination.

Methods: A 3-step process, well evidenced in AIG research, was employed to create the pharmacy MCQs. The first step was developing a cognitive model based on content within the examination blueprint. Second, an item model was developed based on the cognitive model. A process of systematic distractor generation was also incorporated to optimize distractor plausibility. Third, we used computer technology to assemble a set of test items based on the cognitive and item models. A sample of generated items was assessed for quality against Gierl and Lai's 8 guidelines of item quality.

Results: More than 15,000 MCQs were generated to measure knowledge and skill of patient assessment and treatment of nausea and/or vomiting within the scope of clinical pharmacy. A sample of generated items satisfies the requirements of content-related validity and quality after substantive review.

Conclusion: This research demonstrates the AIG process is a viable strategy for creating a test item bank to provide MCQs appropriate for inclusion in a pharmacy licensing examination.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.ajpe.2023.100081DOI Listing

Publication Analysis

Top Keywords

automatic item
8
item generation
8
multiple-choice questions
8
computer technology
8
mcqs appropriate
8
appropriate inclusion
8
cognitive model
8
based cognitive
8
sample generated
8
generated items
8

Similar Publications

Background: Computed tomography (CT) plays a crucial role in assessing chronic rhinosinusitis, but lacks objective quantifiable indicators.

Objective: This study aimed to use deep learning for automated sinus segmentation to generate distinct quantitative scores and explore their correlations with disease-specific quality of life.

Methods: From July 2021 to August 2022, 445 CT data were collected from 2 medical centers.

View Article and Find Full Text PDF

Background: One method for noninvasive and simple urinary microalbumin testing is urine test strips. However, when visually assessing urine test strips, accurate assessment may be difficult due to environmental influences-such as lighting color and intensity-and the physical and psychological influences of the assessor. These complicate the formation of an objective assessment.

View Article and Find Full Text PDF

Use of assistive technology to assess distal motor function in subjects with neuromuscular disease.

PLOS Digit Health

January 2025

Centre Référent Maladies Rares Neuromusculaires, Service de Médecine Physique et de Réadaptation Pédiatrique des Hospices Civils de Lyon - Hôpital Femme Mère Enfant, Bron, France.

Unlabelled: Among the 32 items of the Motor Function Measure scale, 3 concern the assessment of hand function on a paper-based support. Their characteristics make it possible to envisage the use of a tablet instead of the original paper-based support for their completion. This would then make it possible to automate the score to reduce intra- and inter-individual variability.

View Article and Find Full Text PDF

The equivalent value (EV)-based workload assessment of primary healthcare workers in Beijing, China.

Hum Resour Health

January 2025

Health Development Research Department, Capital Institute of Pediatrics, Beijing, 100020, People's Republic of China.

Background: Quantitative methods for estimating the workload of primary healthcare (PHC) workers are essential for improving the performance of PHC institutions. However, measuring the workload of PHC workers is challenging due to the diverse and complex range of services covered by PHC. This study aims to use an equivalent value (EV)-based approach to assess the workload of PHC workers and inform policymakers about the current workload burden in Beijing, China.

View Article and Find Full Text PDF

Introduction: The wearable cyborg Hybrid Assistive Limb (HAL) is a therapeutic exoskeletal device that provides voluntary gait assistance using kinematic/kinetic gait data and bioelectrical signals. By utilizing the gait data automatically measured by HAL, we are developing a system to analyze the wearer's gait during the intervention, unlike conventional evaluations that compare pre- and post-treatment gait test results. Despite the potential use of the gait data from the HAL's sensor information, there is still a lack of analysis using such gait data and knowledge of gait patterns during HAL use.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!