Motivation: Document similarity metrics such as PubMed's 'Find related articles' feature, which have been primarily used to identify studies with similar topics, can now also be used to detect duplicated or potentially plagiarized papers within literature reference databases. However, the CPU-intensive nature of document comparison has limited MEDLINE text similarity studies to the comparison of abstracts, which constitute only a small fraction of a publication's total text. Extending searches to include text archived by online search engines would drastically increase comparison ability. For large-scale studies, submitting short phrases encased in direct quotes to search engines for exact matches would be optimal for both individual queries and programmatic interfaces. We have derived a method of analyzing statistically improbable phrases (SIPs) for assistance in identifying duplicate content.

Results: When applied to MEDLINE citations, this method substantially improves upon previous algorithms in the detection of duplication citations, yielding a precision and recall of 78.9% (versus 50.3% for eTBLAST) and 99.6% (versus 99.8% for eTBLAST), respectively.

Availability: Similar citations identified by this work are freely accessible in the Déjà vu database, under the SIP discovery method category at http://dejavu.vbi.vt.edu/dejavu/.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2872002PMC
http://dx.doi.org/10.1093/bioinformatics/btq146DOI Listing

Publication Analysis

Top Keywords

identifying duplicate
8
statistically improbable
8
improbable phrases
8
search engines
8
duplicate content
4
content statistically
4
phrases motivation
4
motivation document
4
document similarity
4
similarity metrics
4

Similar Publications

Classification of influencing factors of speaking-up behaviour in hospitals: a systematic review.

BMC Health Serv Res

December 2024

Centre for Safety in Healthcare, at the Faculty of Technology, Policy and Management, Delft University of Technology, Jaffalaan 5, Delft, 2628 BX, the Netherlands.

Background: Speaking up among healthcare professionals plays an essential role in improving patient safety and quality of care, yet it remains complex and multifaceted behaviour. Despite awareness of potential risks and adverse outcomes for patients, professionals often hesitate to voice concerns due to various influencing factors. This complexity has encouraged research into the determinants of speaking-up behaviour in hospital settings.

View Article and Find Full Text PDF

Background: Pseudomonas aeruginosa is a major cause of healthcare-associated infections (HAIs), particularly in immunocompromised patients, leading to high morbidity and mortality rates. This study aimed to investigate the antimicrobial resistance patterns, virulence gene profiles, and genetic diversity among P. aeruginosa isolates from hospitalized patients in Mazandaran, Iran.

View Article and Find Full Text PDF

Lonicera caerulea genome reveals molecular mechanisms of freezing tolerance and anthocyanin biosynthesis.

J Adv Res

December 2024

Key Laboratory of Saline-alkali Vegetation Ecology Restoration (Northeast Forestry University), Ministry of Education, Harbin 150040, China; College of Life Science, Northeast Forestry University, Harbin 150040, China. Electronic address:

Introduction: Lonicera caerulea L. (blue honeysuckle) is a noteworthy fleshy-fruited tree and a prominent medicinal plant, which possesses notable characteristics such as exceptional resilience to winter conditions and early maturation, and the richest source of functional anthocyanins, particularly cyanidin-3-glucoside. The molecular mechanisms responsible for its freezing tolerance and anthocyanin biosynthesis remain largely unknown.

View Article and Find Full Text PDF

Genome-wide identification, phylogeny, evolutionary expansion, and expression analyses of ABC gene family in Castanea mollissima under temperature stress.

Plant Physiol Biochem

December 2024

Engineering Research Center of Chestnut Industry Technology, Ministry of Education, Hebei Normal University of Science and Technology, Qinhuangdao, 066004, Hebei, China; Hebei Key Laboratory of Horicultural Germplasm Excavation and Innovative Utilization, College of Horticulture Science and Technology, Hebei Normal University of Science and Technology, Changli, 066600, Hebei, China.

The ATP-binding cassette (ABC) gene family comprises some of the most critical transporter proteins in plants, playing vital roles in maintaining cellular homeostasis and adapting to environmental changes. While ABC transporters have been extensively characterized in various plant species, their profile in C. mollissima remains less understood.

View Article and Find Full Text PDF

Whole genome and transcriptome analysis of pancreatic acinar cell carcinoma elucidates mechanisms of homologous recombination deficiency and unravels novel relevant fusion events.

Pathol Res Pract

December 2024

Department of Pathology and Laboratory Medicine, Weill Cornell Medicine, 1300 York Ave, New York, NY 10065,  USA; Englander Institute for Precision Medicine, Weill Cornell Medicine, 413 East 69th Street, New York, NY 10021, USA. Electronic address:

Pancreatic acinar cell carcinoma (PACC) is a rare pancreatic tumor with a heterogeneous clinical course and, except for radical surgery, limited treatment options. We present a comprehensive study encompassing whole-genome and RNA sequencing of 7 tumor samples from 3 metastatic PACC patients to further delineate its genomic landscape and potential therapeutic implications. Our findings reveal distinct signatures of homologous recombination deficiency (HRD) in patients harboring pathogenic germline BRCA1/2 and FANCL mutations, demonstrating favorable responses to poly (ADP-ribose) polymerase 1 (PARP) inhibitors with prolonged disease-free intervals.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!