Automatic evidence retrieval for systematic reviews.

J Med Internet Res

Centre for Health Informatics, Australian Institute of Health Innovation, University of New South Wales, Kensington NSW, Australia.

Published: October 2014

Background: Snowballing involves recursively pursuing relevant references cited in the retrieved literature and adding them to the search results. Snowballing is an alternative approach to discover additional evidence that was not retrieved through conventional search. Snowballing's effectiveness makes it best practice in systematic reviews despite being time-consuming and tedious.

Objective: Our goal was to evaluate an automatic method for citation snowballing's capacity to identify and retrieve the full text and/or abstracts of cited articles.

Methods: Using 20 review articles that contained 949 citations to journal or conference articles, we manually searched Microsoft Academic Search (MAS) and identified 78.0% (740/949) of the cited articles that were present in the database. We compared the performance of the automatic citation snowballing method against the results of this manual search, measuring precision, recall, and F1 score.

Results: The automatic method was able to correctly identify 633 (as proportion of included citations: recall=66.7%, F1 score=79.3%; as proportion of citations in MAS: recall=85.5%, F1 score=91.2%) of citations with high precision (97.7%), and retrieved the full text or abstract for 490 (recall=82.9%, precision=92.1%, F1 score=87.3%) of the 633 correctly retrieved citations.

Conclusions: The proposed method for automatic citation snowballing is accurate and is capable of obtaining the full texts or abstracts for a substantial proportion of the scholarly citations in review articles. By automating the process of citation snowballing, it may be possible to reduce the time and effort of common evidence surveillance tasks such as keeping trial registries up to date and conducting systematic reviews.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4211030PMC
http://dx.doi.org/10.2196/jmir.3369DOI Listing

Publication Analysis

Top Keywords

systematic reviews
12
citation snowballing
12
automatic method
8
full text
8
review articles
8
automatic citation
8
automatic
5
snowballing
5
citations
5
automatic evidence
4

Similar Publications

The Gender Disparity in Operative Opportunities for Trainee Surgeons: A Review.

J Surg Res

January 2025

Department of Surgery, The University of Melbourne, Parkville, Australia; Department of Neurosurgery, The Royal Melbourne Hospital, Parkville, VIC, Australia.

Introduction: Assessing gender disparity in surgical trainees' operative opportunities and experience quantifies implicit gender bias and reflects a summation of many smaller biased interactions within the operating room environment. Highlighting gender disparity in surgery informs a platform for advocacy.

Methods: A systematic literature search was performed using Medline, Web of Science, OpenMD and Science Direct consistent with the Preferred Reporting Items for Systematic Reviews and Metanalysis guidelines.

View Article and Find Full Text PDF

Background: There is debate as to whether kinematic TKA or mechanical alignment TKA is superior. Recent systematic reviews have suggested that kinematically aligned TKAs may be the preferred option. However, the observed differences in alignment favoring kinematic alignment may not improve outcomes (performance or durability) in ways that patients can perceive, and likewise, statistical differences in outcome scores sometimes observed in clinical trials may be too small for patients to notice.

View Article and Find Full Text PDF

Adherence to Oral Anticancer Agents Among Adults With Gastrointestinal Tract Cancer: A Scoping Review.

Cancer Nurs

January 2025

Author Affiliations: The Nethersole School of Nursing, Faculty of Medicine, Chinese University of Hong Kong, Shatin, Hong Kong (Ms Chen and Drs Ng, Zhang, and Chan); and Nursing Department, People's Hospital of Guangxi Zhuang Autonomous Region, Guangxi Academy of Medical Sciences, Nanning, China (Ms Chen).

Background: Patients with gastrointestinal tract cancer reported suboptimal adherence to oral anticancer agents (OAAs), reducing their therapeutic benefit and increasing mortality risk. A scoping review can comprehensively map available evidence on adherence to OAAs and inform appropriate support to improve treatment outcomes.

Objective: The aim of this study was to comprehensively map studies on adherence to OAAs among adults with gastrointestinal tract cancer, including the adherence rate, nonadherence reasons, influential factors, management strategies, and theories that guide these studies.

View Article and Find Full Text PDF

Background: Early childhood is a critical period for shaping lifelong health behaviors, making early childhood education and care (ECEC) environments ideal for implementing nutrition and physical activity interventions. eHealth tools are increasingly utilized in ECEC settings due to their accessibility, scalability, and cost-effectiveness, demonstrating promise in enhancing educators' practices. Despite the potential effectiveness of these eHealth approaches, a comprehensive collection of available evidence on eHealth tools designed to assess or support best practices for nutrition or physical activity in ECECs is currently lacking.

View Article and Find Full Text PDF

Parental Technoference and Child Problematic Media Use: Meta-Analysis.

J Med Internet Res

January 2025

Shanghai Institute of Early Childhood Education, Shanghai Normal University, Shanghai, China.

Background: Parental technoference, the interruption of parent-child interactions by technology, has been associated with negative outcomes in children's media use. However, the magnitude of this relationship and its moderating factors remain unclear.

Objective: This study aims to systematically examine the relationship between parental technoference and child problematic media use, as well as to identify moderating factors such as age, parental technoference group, study design, and type of problematic media use.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!