Assessing scientists using exploitable metrics can lead to the degradation of research methods even without any strategic behaviour on the part of individuals, via 'the natural selection of bad science.' Institutional incentives to maximize metrics like publication quantity and impact drive this dynamic. Removing these incentives is necessary, but institutional change is slow. However, recent developments suggest possible solutions with more rapid onsets. These include what we call , which can reduce publication bias and improve the efficacy of peer review. In addition, there have been increasing calls for funders to move away from prestige- or innovation-based approaches in favour of lotteries. We investigated whether such changes are likely to improve the reproducibility of science even in the presence of persistent incentives for publication quantity through computational modelling. We found that modified lotteries, which allocate funding randomly among proposals that pass a threshold for methodological rigour, effectively reduce the rate of false discoveries, particularly when paired with open science improvements that increase the publication of negative results and improve the quality of peer review. In the absence of funding that targets rigour, open science improvements can still reduce false discoveries in the published literature but are less likely to improve the overall culture of research practices that underlie those publications.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC6689639PMC
http://dx.doi.org/10.1098/rsos.190194DOI Listing

Publication Analysis

Top Keywords

open science
12
natural selection
8
selection bad
8
publication quantity
8
peer review
8
false discoveries
8
science improvements
8
science modified
4
modified funding
4
funding lotteries
4

Similar Publications

Background: In Asian countries, discussing sex-related issues remains a taboo. Sexual dysfunction is not even considered a serious disorder in Pakistan.

Aim: To explore sexual dysfunction and marital satisfaction within the Pakistani context to develop supportive intervention programs.

View Article and Find Full Text PDF

This study investigates the safety of three different daily dosages of a liquid blend containing kava and kratom (Feel Free® Classic Tonic {FFCT}) in healthy adults over six consecutive days of supplementation. Both kava and kratom have been used traditionally for hundreds of years, but there is limited data on the combined safety of these ingredients. In this randomized, double-blind, placebo-controlled trial, the participants were assigned to receive one of three daily dosages of FFCT or placebo.

View Article and Find Full Text PDF

An empirical study of LLaMA3 quantization: from LLMs to MLLMs.

Vis Intell

December 2024

Department of Information Technology and Electrical Engineering, ETH Zurich, Sternwartstrasse 7, Zürich, Switzerland.

The LLaMA family, a collection of foundation language models ranging from 7B to 65B parameters, has become one of the most powerful open-source large language models (LLMs) and the popular LLM backbone of multi-modal large language models (MLLMs), widely used in computer vision and natural language understanding tasks. In particular, LLaMA3 models have recently been released and have achieved impressive performance in various domains with super-large scale pre-training on over 15T tokens of data. Given the wide application of low-bit quantization for LLMs in resource-constrained scenarios, we explore LLaMA3's capabilities when quantized to low bit-width.

View Article and Find Full Text PDF

Introduction: The present article describes the processed data generated in a qualitative interview study and template analysis. Many women find the experience of being recalled and receiving a false-positive breast screening test result to be distressing. The interview study aimed to understand breast screening healthcare professionals' (HCPs) experiences of providing care during the recall process and when receiving false-positive screening test results, including their communication with women around false-positive screening test results.

View Article and Find Full Text PDF

Open frameworks in the NaMn(PO)F fluoro-pyrophosphates system.

Dalton Trans

January 2025

School of Materials Science and Engineering, Jiangsu University of Science and Technology, Zhenjiang 212100, Jiangsu, China.

Three new sodium manganese fluoro-pyrophosphate compounds, namely, NaMn(PO)F (I), NaMn(PO)F (II), and NaMn(PO)F (III), have been synthesized by heating a mixture of NaPF, NaPOF or NaHPO with different Mn sources in NaNO and KNO fluxes. The structures of the title compounds were characterized single-crystal X-ray diffraction (XRD). II is characteristic of a shell of Na ions that encloses one [Mn(PO)F] unit, whereas I and III reveal three-dimensional (3D) frameworks that consist of MnO, Mn/NaOF octahedra or MnO octahedra and distorted MnO square pyramids with PO units, where Na cations reside in different-membered ring one-dimensional (1D) tunnels.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!