List-type questions, which can have a varying number of answers, are more common in the health domain where people seek for health-related information from a passage or passages. An example of this type of question answering task is to find COVID-19 symptoms from a Twitter post. However, due to the lack of annotated instances for supervised learning, automatic identification of COVID-19 symptoms from Twitter posts is challenging. We investigated detection of symptom mentions in Twitter posts using GPT-3, a pre-trained large language model, along with few-shot learning. Our results of 5-shot and 10-shot learning on a corpus of 655 annotated tweets demonstrate that few-shot learning with pre-trained large language model is a promising approach to answering list-type questions with a minimal amount of effort of annotation.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.3233/SHTI231041 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Evaluating large language models on medical, lay-language, and self-reported descriptions of genetic conditions.
Am J Hum Genet
September 2024
Medical Genomics Unit, National Human Genome Research Institute, National Institutes of Health, 10 Center Dr, Bethesda, MD 20892, USA. Electronic address:
Large language models (LLMs) are generating interest in medical settings. For example, LLMs can respond coherently to medical queries by providing plausible differential diagnoses based on clinical notes. However, there are many questions to explore, such as evaluating differences between open- and closed-source LLMs as well as LLM performance on queries from both medical and non-medical users.
View Article and Find Full Text PDFAnswering List-Type Questions in Health Domain with Pretrained Large Language Model: A Case for COVID-19 Symptoms.
Stud Health Technol Inform
January 2024
Vanderbilt University, Nashville, Tennessee, USA.
List-type questions, which can have a varying number of answers, are more common in the health domain where people seek for health-related information from a passage or passages. An example of this type of question answering task is to find COVID-19 symptoms from a Twitter post. However, due to the lack of annotated instances for supervised learning, automatic identification of COVID-19 symptoms from Twitter posts is challenging.
View Article and Find Full Text PDFSequence tagging for biomedical extractive question answering.
Bioinformatics
August 2022
Department of Computer Science and Engineering, Korea University, Seoul 02841, South Korea.
Motivation: Current studies in extractive question answering (EQA) have modeled the single-span extraction setting, where a single answer span is a label to predict for a given question-passage pair. This setting is natural for general domain EQA as the majority of the questions in the general domain can be answered with a single span. Following general domain EQA models, current biomedical EQA (BioEQA) models utilize the single-span extraction setting with post-processing steps.
View Article and Find Full Text PDFDo different response formats affect how test takers approach a clinical reasoning task? An experimental study on antecedents of diagnostic accuracy using a constructed response and a selected response format.
Adv Health Sci Educ Theory Pract
October 2021
Department of Emergency Medicine, Inselspital University Hospital, University of Berne, 3010, Freiburgstrasse, Berne, Switzerland.
The use of response formats in assessments of medical knowledge and clinical reasoning continues to be the focus of both research and debate. In this article, we report on an experimental study in which we address the question of how much list-type selected response formats and short-essay type constructed response formats are related to differences in how test takers approach clinical reasoning tasks. The design of this study was informed by a framework developed within cognitive psychology which stresses the importance of the interplay between two components of reasoning-self-monitoring and response inhibition-while solving a task or case.
View Article and Find Full Text PDFMulti-label biomedical question classification for lexical answer type prediction.
J Biomed Inform
May 2019
Al-Khawarizmi Institute of Computer Science, UET, Lahore, Pakistan.
Question classification is considered one of the most significant phases of a typical Question Answering (QA) system. It assigns certain answer types to each question which leads to narrow down the search space of possible answers for factoid and list type questions. The process of assigning certain answer types to each question is also known as Lexical Answer Type (LAT) Prediction.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!