Purpose: Text summarization of clinical trial descriptions has the potential to reduce the time required to familiarize oneself with the subject of studies by condensing long-form detailed descriptions to concise, meaning-preserving synopses. This work describes the process and quality of automatically generated summaries of clinical trial descriptions using extractive text summarization methods.
Methods: We generated a novel dataset from the detailed descriptions and brief summaries of trials registered on clinicaltrials.gov. We executed several text summarization algorithms on the detailed descriptions in this corpus and calculated the standard ROUGE metrics using the brief summaries included in the record as a reference. To investigate the correlation of these metrics with human sentiments, four reviewers assessed the content-completeness of the generated summaries and the helpfulness of both the generated and reference summaries via a Likert scale questionnaire.
Results: The filtering stages of the dataset generation process reduce the 277,228 trials registered on clinicaltrials.gov to 101,016 records usable for the summarization task. On average, the summaries in this corpus are 25% the length of the detailed descriptions. Of the evaluated text summarization methods, the TextRank algorithm exhibits the overall best performance with a ROUGE-1 F1 score of 0.3531, ROUGE-2 F1 score of 0.1723, and ROUGE-L F1 score of 0.3003. These scores correlate with the assessment of the helpfulness and content similarity by the human reviewers. Inter-rater agreement for the helpfulness and content similarity was slight and fair respectively (Fleiss' kappa of 0.12 and 0.22).
Conclusions: Extractive summarization is a viable tool for generating meaning-preserving synopses of detailed clinical trial descriptions. Further, the human evaluation has shown that the ROUGE-L F1 score is useful for rating the general quality of generated summaries of clinical trial descriptions in an automated way.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.ijmedinf.2019.05.019 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Controlled human infection studies accelerate vaccine development.
J Infect Dis
January 2025
Center for Vaccine Development and Global Health, University of Maryland School of Medicine, Baltimore, Maryland 21218, USA.
Clinical trials that employ human challenge, also known as controlled human infection models (CHIM), have rapidly advanced vaccine development for multiple pathogens, including at least 30 disease models to date. CHIM studies, championed by networks of researchers, regulators, ethicists, technical experts, and other stakeholders, limit exposure of individuals to an investigational product, de-risk product investments, identify correlates of protection, and most importantly provide a prompt readout of vaccine efficacy. While CHIM studies provide multiple advantages, important challenges exist, including strengthening the relevance and comparability of CHIM study results to efficacy trials in endemic areas, particularly in resource-limited settings.
View Article and Find Full Text PDFReal-Time fMRI Neurofeedback Modulation of Dopaminergic Midbrain Activity in Young Adults With Elevated Internet Gaming Disorder Risk: Randomized Controlled Trial.
J Med Internet Res
January 2025
Centre for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Macau, China.
This study provides preliminary evidence for real-time functional magnetic resonance imaging neurofeedback (rt-fMRI NF) as a potential intervention approach for internet gaming disorder (IGD). In a preregistered, randomized, single-blind trial, young individuals with elevated IGD risk were trained to downregulate gaming addiction-related brain activity. We show that, after 2 sessions of neurofeedback training, participants successfully downregulated their brain responses to gaming cues, suggesting the therapeutic potential of rt-fMRI NF for IGD (Trial Registration: ClinicalTrials.
View Article and Find Full Text PDFEffectiveness of Different Intervention Modes in Lifestyle Intervention for the Prevention of Type 2 Diabetes and the Reversion to Normoglycemia in Adults With Prediabetes: Systematic Review and Meta-Analysis of Randomized Controlled Trials.
J Med Internet Res
January 2025
School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
Background: Lifestyle interventions have been acknowledged as effective strategies for preventing type 2 diabetes mellitus (T2DM). However, the accessibility of conventional face-to-face interventions is often limited. Digital health intervention has been suggested as a potential solution to overcome the limitation.
View Article and Find Full Text PDFImpact of the Mediterranean Diet on Patients With Psoriasis: Protocol for a Randomized Controlled Trial.
JMIR Res Protoc
January 2025
Department of Dermatology, Hospital Universitario Ramon y Cajal, Instituto Ramón y Cajal de Investigación Sanitaria (IRYCIS), Madrid, Spain, Madrid, Spain.
Background: Psoriasis is an inflammatory disease primarily treated through molecular-targeted therapies. However, emerging evidence suggests that dietary interventions may also play a role in managing inflammation associated with this condition. The Mediterranean diet (MedDiet), prevalent in southern European countries, has been widely recognized for its ability to reduce cardiovascular mortality, largely due to its anti-inflammatory properties.
View Article and Find Full Text PDFOral Regimens for Rifampin-Resistant, Fluoroquinolone-Susceptible Tuberculosis.
N Engl J Med
January 2025
From Médecins Sans Frontières (L.G., F.V.), Sorbonne Université, INSERM Unité 1135, Centre d'Immunologie et des Maladies Infectieuses (L.G.), Assistance Publique-Hôpitaux de Paris, Groupe Hospitalier Universitaire Sorbonne Université, Hôpital Pitié-Salpêtrière, Centre National de Référence des Mycobactéries et de la Résistance des Mycobactéries aux Antituberculeux (L.G.), and Epicentre (M.G., E. Baudin), Paris, and Translational Research on HIV and Endemic and Emerging Infectious Diseases, Montpellier Université de Montpellier, Montpellier, Institut de Recherche pour le Développement, Montpellier, INSERM, Montpellier (M.B.) - all in France; Interactive Development and Research, Singapore (U.K.); McGill University, Epidemiology, Biostatistics, and Occupational Health, Montreal (U.K.); UCSF Center for Tuberculosis (G.E.V., P.N., P.P.J.P.) and the Division of HIV, Infectious Diseases, and Global Medicine (G.E.V.), University of California at San Francisco, San Francisco; the National Scientific Center of Phthisiopulmonology (A.A., E. Berikova) and the Center of Phthisiopulmonology of Almaty Health Department (A.K.), Almaty, and the City Center of Phthisiopulmonology, Astana (Z.D.) - all in Kazakhstan; Médecins Sans Frontières (C.B., I.M.), the Medical Research Council Clinical Trials Unit at University College London (I.M.), and St. George's University of London Institute for Infection and Immunity (S.W.) - all in London; MedStar Health Research Institute, Washington, DC (M.C.); Médecins Sans Frontières, Mumbai (V. Chavan), the Indian Council of Medical Research Headquarters-New Delhi, New Delhi (S. Panda), and the Indian Council of Medical Research-National AIDS Research Institute, Pune (S. Patil) - all in India; the Centre for Infectious Disease Epidemiology and Research (V. Cox) and the Department of Medicine (H. McIlleron), University of Cape Town, and the Wellcome Centre for Infectious Diseases Research in Africa, Institute of Infectious Disease and Molecular Medicine (S.W.) - both in Cape Town, South Africa; the Institute of Tropical Medicine, Antwerp, Belgium (B. C. J.); Médecins Sans Frontières, Geneva (G.F., N.L.); Médecins Sans Frontières, Yerevan, Armenia (O.K.); the National Center for Tuberculosis and Lung Diseases, Tbilisi, Georgia (N.K.); Partners In Health (M.K.) and Jhpiego Lesotho (L.O.) - both in Maseru; Socios En Salud Sucursal Peru (L.L., S.M.-T., J.R., E.S.-G., D.E.V.-V.), Hospital Nacional Sergio E. Bernales, Centro de Investigacion en Enfermedades Neumologicas (E.S.-G.), Hospital Nacional Dos de Mayo (E.T.), Universidad Nacional Mayor de San Marcos (E.T.), and Hospital Nacional Hipólito Unanue (D.E.V.-V.) - all in Lima; Global Health and Social Medicine, Harvard Medical School (L.L., K.J.S., M.L.R., C.D.M.), Partners In Health (L.L., K.J.S., M.L.R., C.D.M.), the Division of Global Health Equity, Brigham and Women's Hospital (K.J.S., M.L.R., C.D.M.), the Department of Biostatistics and Computational Biology, Dana-Farber Cancer Institute, (L.T.), and Harvard T.H. Chan School of Public Health (L.T.) - all in Boston; and the Indus Hospital and Health Network, Karachi, Pakistan (H. Mushtaque, N.S.).
Background: For decades, poor treatment options and low-quality evidence plagued care for patients with rifampin-resistant tuberculosis. The advent of new drugs to treat tuberculosis and enhanced funding now permit randomized, controlled trials of shortened-duration, all-oral treatments for rifampin-resistant tuberculosis.
Methods: We conducted a phase 3, multinational, open-label, randomized, controlled noninferiority trial to compare standard therapy for treatment of fluoroquinolone-susceptible, rifampin-resistant tuberculosis with five 9-month oral regimens that included various combinations of bedaquiline (B), delamanid (D), linezolid (L), levofloxacin (Lfx) or moxifloxacin (M), clofazimine (C), and pyrazinamide (Z).
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!