Background: The European Centres of Reference Network for Cystic Fibrosis (ECORN-CF) established an Internet forum which provides the opportunity for CF patients and other interested people to ask experts questions about CF in their mother language. The objectives of this study were to: 1) develop a detailed quality assessment tool to analyze quality of expert answers, 2) evaluate the intra- and inter-rater agreement of this tool, and 3) explore changes in the quality of expert answers over the time frame of the project.
Methods: The quality assessment tool was developed by an expert panel. Five experts within the ECORN-CF project used the quality assessment tool to analyze the quality of 108 expert answers published on ECORN-CF from six language zones. 25 expert answers were scored at two time points, one year apart. Quality of answers was also assessed at an early and later period of the project. Individual rater scores and group mean scores were analyzed for each expert answer.
Results: A scoring system and training manual were developed analyzing two quality categories of answers: content and formal quality. For content quality, the grades based on group mean scores for all raters showed substantial agreement between two time points, however this was not the case for the grades based on individual rater scores. For formal quality the grades based on group mean scores showed only slight agreement between two time points and there was also poor agreement between time points for the individual grades. The inter-rater agreement for content quality was fair (mean kappa value 0.232 ± 0.036, p < 0.001) while only slight agreement was observed for the grades of the formal quality (mean kappa value 0.105 ± 0.024, p < 0.001). The quality of expert answers was rated high (four language zones) or satisfactory (two language zones) and did not change over time.
Conclusions: The quality assessment tool described in this study was feasible and reliable when content quality was assessed by a group of raters. Within ECORN-CF, the tool will help ensure that CF patients all over Europe have equal possibility of access to high quality expert advice on their illness.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3311602 | PMC |
| http://dx.doi.org/10.1186/1471-2288-12-11 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Backgrounds: Biomedical research requires sophisticated understanding and reasoning across multiple specializations. While large language models (LLMs) show promise in scientific applications, their capability to safely and accurately support complex biomedical research remains uncertain.
Methods: We present , a novel question-and-answer benchmark for evaluating LLMs in biomedical research.
Large language models for pretreatment education in pediatric radiation oncology: A comparative evaluation study.
Clin Transl Radiat Oncol
March 2025
Department of Radiation Oncology, Maria Sklodowska-Curie National Research Institute of Oncology, Wawelska 15B, 02-034 Warsaw, Poland.
Background And Purpose: Pediatric radiotherapy patients and their parents are usually aware of their need for radiotherapy early on, but they meet with a radiation oncologist later in their treatment. Consequently, they search for information online, often encountering unreliable sources. Large language models (LLMs) have the potential to serve as an educational pretreatment tool, providing reliable answers to their questions.
View Article and Find Full Text PDFPublic Reason in Times of Corona: Countering Disinformation in the Netherlands.
Camb Q Healthc Ethics
January 2025
Erasmus School of Law and Erasmus School of Health Policy & Management, Erasmus University Rotterdam, Rotterdam, The Netherlands.
Who should decide what passes for disinformation in a liberal democracy? During the COVID-19 pandemic, a committee set up by the Dutch Ministry of Health was actively blocking disinformation. The committee comprised civil servants, communication experts, public health experts, and representatives of commercial online platforms such as Facebook, Twitter, and LinkedIn. To a large extent, vaccine hesitancy was attributed to disinformation, defined as misinformation (or data misinterpreted) with harmful intent.
View Article and Find Full Text PDFExperentia Et Progressus: An Experiential Needs Assessment of Military Health care Providers in Treating Pediatric Combat Trauma.
Mil Med
January 2025
Department of Pediatrics, Uniformed Services University, Bethesda, MD 20814, USA.
Introduction: Children are among the most vulnerable populations affected by armed conflicts, yet there is limited data on the preparedness of military medical personnel to care for pediatric combat trauma casualties in austere or large-scale combat operations. This study aimed to assess the confidence, training needs, and resource requirements of military medical providers who have managed pediatric patients during deployment.
Materials And Methods: This IRB-exempt, cross-sectional mixed-methods study used a survey created via a modified Delphi method with input from subject matter experts.
Are glucagon-like-peptide-1 (GLP-1) receptor agonists useful in treating Parkinson's disease (PD). Does the clinical trial with lixisenatide add anything?
Expert Opin Investig Drugs
January 2025
School of Pharmacy and Medical Sciences, Griffith University, Brisbane, Australia.
Introduction: Parkinson's disease (PD) is a common neurodegenerative disease. Glucagon-Like-Peptide-1 (GLP-1) receptor agonists decrease the incidence of developing PD, and are being considered for the treatment of PD.
Areas Covered: A phase 2 clinical trial of lixisenatide, a GLP-1 receptor agonist, in the early stages of PD.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!