Background: The peer review process is the gold standard by which academic manuscripts are vetted for publication. However, some investigators have raised concerns regarding its unopposed supremacy, including lack of expediency, susceptibility to editorial bias and statistical limitation due to the small number of reviewers used. Post-publication review-in which the article is assessed by the general readership of the journal instead of a small group of appointed reviewers-could potentially supplement or replace the peer-review process. In this study, we created a computer model to compare the traditional peer-review process to that of post-publication reader review.
Methods: We created a mathematical model of the manuscript review process. A hypothetical manuscript was randomly assigned a "true value" representing its intrinsic quality. We modeled a group of three expert peer reviewers and compared it to modeled groups of 10, 20, 50, or 100 reader-reviewers. Reader-reviewers were assumed to be less skillful at reviewing and were thus modeled to be only ¼ as accurate as expert reviewers. Percentage of correct assessments was calculated for each group.
Results: 400,000 hypothetical manuscripts were modeled. The accuracy of the reader-reviewer group was inferior to the expert reviewer group in the 10-reviewer trial (93.24% correct vs. 97.67%, p < 0.0001) and the 20-reviewer trial (95.50% correct, p < 0.0001). However, the reader-reviewer group surpassed the expert reviewer group in accuracy when 50 or 100 reader-reviewers were used (97.92 and 99.20% respectively, p < 0.0001).
Conclusions: In a mathematical model of the peer review process, the accuracy of public reader-reviewers can surpass that of a small group of expert reviewers if the group of public reviewers is of sufficient size. Further study will be required to determine whether the mathematical assumptions of this model are valid in actual use.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1007/s00464-012-2171-1 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Disentangling emotional source memory: a mega-analysis on the effects of emotion on item-context binding in episodic long-term memory.
Front Psychol
December 2024
Department of Biological Psychology and Affective Science, Faculty of Human Sciences, University of Potsdam, Potsdam, Germany.
Introduction: It has long been known that highly arousing emotional single items are better recollected than low arousing neutral items. Despite the robustness of this memory advantage, emotional arousing events may not always promote the retrieval of source details (i.e.
View Article and Find Full Text PDFPolyphenol metabolomics reveals the applications and prospects of polyphenol-rich plants in natural dyes.
For Res (Fayettev)
December 2024
State Key Laboratory of Tree Genetics and Breeding, Chinese Academy of Forestry, Beijing 100091, China.
Polyphenols, as one of the primary compounds produced by plant secondary metabolism, have garnered considerable attention because of their non-toxic, environmentally friendly, and biodegradable properties, as well as their notable medicinal value. This study presents a metabolomic analysis of polyphenols from 11 woody plants, including , , and , investigating a total of 40 polyphenolic metabolites. A differential metabolite dynamics map highlighted the five most differentiated substances among the 11 plants, including vitexin, dihydromyricetin, genistin, resveratrol, and isorhamnetin.
View Article and Find Full Text PDFVirtual patients with substance use disorders in healthcare professional education: a scoping review.
Can Med Educ J
December 2024
Department of Community Health Sciences, Addiction Studies and Research Programs, Université de Sherbrooke, Quebec, Canada.
Background And Objective: Virtual patient simulations are cost-effective methods for training health professionals. Yet, this teaching method is rarely used with clinicians who work or plan on working with people with substance use disorders. This scoping review summarizes the current state of the literature concerning virtual substance use disorder patient simulations in health professionals' training and provides suggestions for future directions.
View Article and Find Full Text PDFA practical guide for nephrologist peer reviewers: understanding and appraising Mendelian randomization studies.
Ren Fail
December 2025
Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA.
Identifying risk factors for disease onset and progression has been a core focus in nephrology research. Mendelian Randomization (MR) has emerged as a powerful genetic epidemiological approach, utilizing genome-wide association studies (GWAS) to establish causal relationships between modifiable risk factors and kidney disease outcomes. MR uses genetic variants as instrumental variables to infer causal relationships between exposures and disease outcomes.
View Article and Find Full Text PDFImpact of mindfulness-based tri-modal prehabilitation on functional recovery and selected surgical outcomes of patients with colorectal cancer admitted to surgical hospital wards: the first international randomised control trial for mindfulness-based tri-modal prehabilitation.
BMJ Open
December 2024
Centre for Mindfulness-Based Research and Practices, University of Sri Jayewardenepura, Nugegoda, Sri Lanka
Introduction: Colorectal cancer (CRC) is the third most common and second most deadly cancer worldwide, with significant morbidity and mortality risks. Despite advancements in surgical care, postoperative complications and recovery challenges persist. The severity of these issues is linked to preoperative functional capacity and emotional distress.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!