Three Modeling Applications to Promote Automatic Item Generation for Examinations in Dentistry.

J Dent Educ

Dr. Lai is Assistant Professor, University of Alberta School of Dentistry; Dr. Gierl is Professor and Canada Research Chair in Educational Measurement, University of Alberta Faculty of Education; Dr. Byrne is Professor of Endodontics and Senior Associate Dean, Virginia Commonwealth University School of Dentistry; Dr. Spielman is Professor and Associate Dean for Academic Affairs, New York University College of Dentistry; and Dr. Waldschmidt is Director of Testing Services, American Dental Association and Secretary of the Joint Commission on National Dental Examinations.

Published: March 2016

Test items created for dentistry examinations are often individually written by content experts. This approach to item development is expensive because it requires the time and effort of many content experts but yields relatively few items. The aim of this study was to describe and illustrate how items can be generated using a systematic approach. Automatic item generation (AIG) is an alternative method that allows a small number of content experts to produce large numbers of items by integrating their domain expertise with computer technology. This article describes and illustrates how three modeling approaches to item content-item cloning, cognitive modeling, and image-anchored modeling-can be used to generate large numbers of multiple-choice test items for examinations in dentistry. Test items can be generated by combining the expertise of two content specialists with technology supported by AIG. A total of 5,467 new items were created during this study. From substitution of item content, to modeling appropriate responses based upon a cognitive model of correct responses, to generating items linked to specific graphical findings, AIG has the potential for meeting increasing demands for test items. Further, the methods described in this study can be generalized and applied to many other item types. Future research applications for AIG in dental education are discussed.

Download full-text PDF

Source

Publication Analysis

Top Keywords

test items
16
content experts
12
items
9
three modeling
8
automatic item
8
item generation
8
examinations dentistry
8
dentistry test
8
items created
8
items generated
8

Similar Publications

Aims: This study aimed to evaluate the impact of community-based dental education (CBDE) on the learning experiences of undergraduate dental students and recent dental graduates from two diverse geographical regions.

Methods: The study followed a cross-sectional design, conducted online using Google Forms, with ethical approval from Qatar University. A non-probability purposive sampling method was used to recruit dental students and recent graduates from three institutions in India and one in Qatar.

View Article and Find Full Text PDF

Background And Aims: Previous results of the Dermatology-Life-Quality-Index (DLQI) validation in Colombia based on the classical test theory (CTT) perspective have showed the need to delve into its measurement properties. Therefore, we aimed to assess the structural validity, internal consistency and item response analysis of the DLQI through the item response theory (IRT) or the Rasch model.

Material And Methods: We assessed the dimensionality of the DLQI, determined its difficulty, discrimination and differential functioning and went on to evaluate its internal consistency and discriminative validity among patients with inflammatory and non-inflammatory skin disease.

View Article and Find Full Text PDF

Background: Research has shown that engaging in a range of healthy lifestyles or behavioral factors can help reduce the risk of developing dementia. Improved knowledge of modifiable risk factors for dementia may help engage people to reduce their risk, with beneficial impacts on individual and public health. Moreover, many guidelines emphasize the importance of providing education and web-based resources for dementia prevention.

View Article and Find Full Text PDF

Background: Congenital heart disease (CHD) is a birth defect of the heart that requires long-term care and often leads to additional health complications. Effective educational strategies are essential for improving health literacy and care outcomes. Despite affecting around 40,000 children annually in the United States, there is a gap in understanding children's health literacy, parental educational burdens, and the efficiency of health care providers in delivering education.

View Article and Find Full Text PDF

It has long been debated whether latent memory signals determine recognition judgments directly or through a small number of discrete states. Often, signal detection theory (SDT) models instantiate the former perspective, whereas the two-high-threshold (2HT) model instantiates the latter. Kellen and Klauer (2014) conducted a critical test using a ranking paradigm that yielded results in line with common SDT models and incompatible with the 2HT model.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!