Publications by authors named "B A Nosek"

Replications are important for assessing the reliability of published findings. However, they are costly, and it is infeasible to replicate everything. Accurate, fast, lower-cost alternatives such as eliciting predictions could accelerate assessment for rapid policy implementation in a crisis and help guide a more efficient allocation of scarce replication resources.

View Article and Find Full Text PDF
Article Synopsis
  • This study investigates the use of decision markets to choose which social science experiments should be replicated, focusing on outcomes of 41 close replications of MTurk experiments.
  • Researchers found that the highest-ranking studies in the market had an 83% replication success rate, while the lowest-ranking studies had only a 33% success rate.
  • Overall, about 54% of the experiments were successfully replicated, with effect sizes averaging 45% of the original values, indicating that replicability in MTurk experiments is on par with past laboratory replication projects.
View Article and Find Full Text PDF

Open data collected from research participants creates a tension between scholarly values of transparency and sharing, on the one hand, and privacy and security, on the other hand. A common solution is to make data sets anonymous by removing personally identifying information (e.g.

View Article and Find Full Text PDF

Failures to replicate evidence of new discoveries have forced scientists to ask whether this unreliability is due to suboptimal implementation of methods or whether presumptively optimal methods are not, in fact, optimal. This paper reports an investigation by four coordinated laboratories of the prospective replicability of 16 novel experimental findings using rigour-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency. In contrast to past systematic replication efforts that reported replication rates averaging 50%, replication attempts here produced the expected effects with significance testing (P < 0.

View Article and Find Full Text PDF