Critical to producing accessible content is an understanding of what characteristics affect understanding and comprehension. To answer this question, we are producing a large corpus of health-related texts with associated questions that can be read or listened to by study participants to measure the difficulty of the underlying content, which can later be used to better understand text difficulty and user comprehension. In this paper, we examine methods for automatically generating multiple-choice questions using Google's related questions and ChatGPT. Overall, we find both algorithms generate reasonable questions that are complementary; ChatGPT questions are more similar to the snippet while Google related-search questions have more lexical variation.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141817PMC

Publication Analysis

Top Keywords

multiple-choice questions
8
questions
7
comparison google
4
google chatgpt
4
chatgpt automatic
4
automatic generation
4
generation health-related
4
health-related multiple-choice
4
questions critical
4
critical producing
4

Similar Publications

Exploring the experiences of women and people with diabetes in pregnancy in metropolitan and rural Australia: a national survey.

BMC Pregnancy Childbirth

January 2025

Department of Rural Health, College of Health, Medicine and Wellbeing, University of Newcastle, Tamworth, NSW, Australia.

Background: Women and people diagnosed with diabetes in pregnancy, are recommended to have frequent monitoring and careful management for optimal pregnancy outcomes. This health care management should be supported by a multidisciplinary healthcare team. For individuals living in rural areas, there are increased barriers to healthcare access, with subsequent worse health outcomes compared to those in metropolitan regions.

View Article and Find Full Text PDF

Introduction: As artificial intelligence systems like large language models (LLM) and natural language processing advance, the need to evaluate their utility within medicine and medical education grows. As medical research publications continue to grow exponentially, AI systems offer valuable opportunities to condense and synthesize information, especially in underrepresented areas such as Sleep Medicine. The present study aims to compare summarization capacity between LLM generated summaries of sleep medicine research article abstracts, to summaries generated by Medical Student (humans) and to evaluate if the research content, and literary readability summarized is retained comparably.

View Article and Find Full Text PDF

The Effect of Muscle Cramps During Hemodialysis on Quality of Life and Habitual Physical Activity.

Medicina (Kaunas)

December 2024

Department of Nephrology, Hypertension, Transplantation and Internal Medicine, Central University Hospital, Medical University of Lodz, Pomorska 251, 92-213 Lodz, Poland.

: This study aimed to evaluate the association between QoL, self-assessed physical activity, and the presence and severity of muscle spasms in chronic hemodialysis patients. Patients undergoing regular in-center hemodialysis (HD) have much lower quality of life (QoL) than healthy individuals. However, there is limited knowledge about the impact of specific common complications of hemodialysis, particularly muscle spasms on the overall well-being of patients.

View Article and Find Full Text PDF

Tips for Incorporating Authentic Assessment into Health Profession Courses.

Med Sci Educ

December 2024

Division of Oral and Craniofacial Health Sciences, Adams School of Dentistry, University of North Carolina at Chapel Hill, Chapel Hill, USA.

Student engagement with learning material is significantly affected by if, and how, students will be assessed. Despite the influence of assessment technique on student engagement, traditional methods like multiple-choice question examinations are most common despite known limitations. Authentic assessment, an alternative option, is a method that simulates a real-world scenario or problem encountered in practice where students must demonstrate a task or skill or create a product as a final outcome.

View Article and Find Full Text PDF

Unlabelled: Interpretation of images and spatial relationships is essential in medicine, but the evidence base on how to assess these skills is sparse. Thirty medical students were randomized into two groups (A and B), and invited to "think aloud" while completing 14 histology MCQs. All students answered six identical MCQs, three with only text and three requiring image interpretation.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!