What is the sensitivity and specificity of the peer review process?

Account Res

Departamento de Ciencias de la Computación e I. A, CITIC-UGR, Universidad de Granada, Granada, Spain.

Published: May 2024

In this paper, we introduce the concepts of sensitivity and specificity to mathematically describe the accuracy of the peer review process. Sensitivity refers to the probability that the final decision for a manuscript would be acceptance, provided the manuscript meets the journal standards required for publication (i.e., true positive rate). Specificity refers to the probability that the final decision would be rejection, provided the work does not meet the standards required for publication (i.e., true negative rate). Therefore, in the peer review process, sensitivity measures the ability to correctly accept manuscripts that meet the required standards (true positives) and specificity measures the ability to correctly reject manuscripts that do not meet those quality standards required for publication (true negatives). Sensitivity and specificity values can inform the editor under what conditions the outcome of a peer review process becomes more precise and, therefore, if this does not occur, when the editor must improve the analysis involved in processing the information received from reviewers' reports. Sensitivity and specificity understood in this way can promote the ethical conduct of peer review processes and improve the validity of manuscript editorial decisions.

Download full-text PDF

Source
http://dx.doi.org/10.1080/08989621.2022.2122817DOI Listing

Publication Analysis

Top Keywords

peer review
20
sensitivity specificity
16
review process
12
standards required
12
required publication
12
publication true
12
process sensitivity
8
refers probability
8
probability final
8
final decision
8

Similar Publications

"The Brain is…": A Survey of the Brain's Many Definitions.

Neuroinformatics

January 2025

Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 760 Westwood Plaza, Los Angeles, CA, 90024, USA.

A reader of the peer-reviewed neuroscience literature will often encounter expressions like the following: 'the brain is a dynamic system', 'the brain is a complex network', or 'the brain is a highly metabolic organ'. These expressions attempt to define the essential functions and properties of the mammalian or human brain in a simple phrase or sentence, sometimes using metaphors or analogies. We sought to survey the most common phrases of the form 'the brain is…' in the biomedical literature to provide insights into current conceptualizations of the brain.

View Article and Find Full Text PDF

Background: The benefit of treatment with tyrosine kinase inhibitors targeting the epidermal growth factor receptor (EGFR-TKI) for lung adenocarcinoma (ADC), stratified by ethnicity, has not yet been fully elucidated.

Methods: We searched PubMed, Embase, and Cochrane databases for studies that investigated EGFR-TKI for lung ADC. We computed hazard ratios (HRs) or risk ratios (RRs) for binary endpoints, with 95% confidence intervals (CIs).

View Article and Find Full Text PDF

Introduction: Cardiovascular disease (CVD) is the leading cause of death for women in the United States, and U.S. female Veterans have higher rates of CVD compared to civilian women.

View Article and Find Full Text PDF

Objectives: Our aim was to systematically review the cost-effectiveness of proton pump inhibitor (PPI) therapies and surgical interventions for gastro-oesophageal reflux disease (GORD).

Design: The study design was a systematic review of economic evaluations.

Data Sources: We searched PubMed, Embase, Scopus, and Web of Science for publications from January 1990 to March 2023.

View Article and Find Full Text PDF

Background: The human microbiome is crucial in regulating intestinal and systemic functions. While its role in cardiovascular disease is better understood, the link between intestinal microbiota and valvular heart diseases (VHD) remains largely unexplored.

Methods: Peer-reviewed studies on human, animal or cell models analysing gut microbiota profiles published up to April 2024 were included.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!