AI Article Synopsis

  • This study investigates the use of decision markets to choose which social science experiments should be replicated, focusing on outcomes of 41 close replications of MTurk experiments.
  • Researchers found that the highest-ranking studies in the market had an 83% replication success rate, while the lowest-ranking studies had only a 33% success rate.
  • Overall, about 54% of the experiments were successfully replicated, with effect sizes averaging 45% of the original values, indicating that replicability in MTurk experiments is on par with past laboratory replication projects.

Article Abstract

Here we test the feasibility of using decision markets to select studies for replication and provide evidence about the replicability of online experiments. Social scientists (n = 162) traded on the outcome of close replications of 41 systematically selected MTurk social science experiments published in PNAS 2015-2018, knowing that the 12 studies with the lowest and the 12 with the highest final market prices would be selected for replication, along with 2 randomly selected studies. The replication rate, based on the statistical significance indicator, was 83% for the top-12 and 33% for the bottom-12 group. Overall, 54% of the studies were successfully replicated, with replication effect size estimates averaging 45% of the original effect size estimates. The replication rate varied between 54% and 62% for alternative replication indicators. The observed replicability of MTurk experiments is comparable to that of previous systematic replication projects involving laboratory experiments.

Download full-text PDF

Source
http://dx.doi.org/10.1038/s41562-024-02062-9DOI Listing

Publication Analysis

Top Keywords

replicability online
8
online experiments
8
studies replication
8
replication rate
8
size estimates
8
replication
7
experiments
5
examining replicability
4
selected
4
experiments selected
4

Similar Publications

Accurate and timely genetic material replication is essential for preserving genomic integrity. The replication process begins with chromatin licensing and DNA replication factor 1 (CDT1). It has been demonstrated that dysregulated CDT1 expression causes genomic instability, damages DNA, and may even cause cancer.

View Article and Find Full Text PDF

Study Design: Retrospective cohort.

Objective: To analyze the annual trends in the most prevalent topics, journals, and geographic regions of the top 100 spine surgery articles, as determined by altmetric attention scores (AASs). We also describe the relationship between AAS and traditional article metrics.

View Article and Find Full Text PDF

Objectification theory posits that self-objectification can lead to disordered eating, with significant positive correlations between self-objectification and eating disorder (ED) psychopathology found in women in both clinical and non-clinical samples. Maladaptive rumination is another process frequently associated with EDs, but its relationship with self-objectification and ED psychopathology needs further investigation. Our aim was to conduct a preliminary test to investigate whether maladaptive rumination mediated the relationship between self-objectification and ED psychopathology in women.

View Article and Find Full Text PDF

Background: Motivated behaviors vary widely across individuals and are controlled by a range of environmental and intrinsic factors. However, due to a lack of objective measures, the role of intrinsic extrinsic control of motivation in psychiatric disorders remains poorly understood.

Methods: We developed a novel multi-factorial behavioral task that separates the distinct contributions of intrinsic extrinsic control, and determines their influence on motivation and outcome sensitivity in a range of contextual environments.

View Article and Find Full Text PDF
Article Synopsis
  • The Functionality Appreciation Scale (FAS) measures how much individuals appreciate their body's abilities, with a focus on validating the French version through three studies.
  • Study 1 involved 383 young women and found good reliability and validity, while also confirming a single-factor structure.
  • Study 2 and 3 confirmed this structure through further analyses in diverse groups, reinforcing the scale's consistency and supportive findings across both genders, solidifying its use for French populations.
View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!