Scoping review and evidence mapping of interventions aimed at improving reproducible and replicable science: Protocol.

Background: Many interventions, especially those linked to open science, have been proposed to improve reproducibility in science. To what extent these propositions are based on scientific evidence from empirical evaluations is not clear.

Aims: The primary objective is to identify Open Science interventions that have been formally investigated regarding their influence on reproducibility and replicability.

Consensus meetings will outperform integrative experiments.

We expect that consensus meetings, where researchers come together to discuss their theoretical viewpoints, prioritize the factors they agree are important to study, standardize their measures, and determine a smallest effect size of interest, will prove to be a more efficient solution to the lack of coordination and integration of claims in science than integrative experiments.

We don't know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing.

In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers' analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings.

Start Small, not Random: Why does Justifying your Time-Lag Matter?

Repeated measurement designs have been growing in popularity in the fields of Organizational Behavior and Work and Organizational Psychology. This brings up questions regarding the appropriateness of time-lag choices and validity of justification used to make time-lag decisions in the current literature. We start by explaining how time-lag choices are typically made and explain issues associated with these approaches.