The reporting of exaggerated effect size estimates may occur either through researchers accepting statistically significant results when power is inadequate and/or from repeated measures approaches aggregating, averaging multiple items, or multiple trials. Monte-Carlo simulations with input of a small, medium, or large effect size were conducted on multiple items or trials that were either averaged or aggregated to create a single dependent measure. Alpha was set at the .05 level, and the trials were assessed over item or trial correlations ranging from 0 to 1. Simulations showed a large increase in observed effect size averages and the power to accept these estimates as statistically significant increased over numbers of trials or items. Overestimation effects were mitigated as correlations between trials increased but still remained substantial in some cases. The implications of these findings for meta-analyses and different research scenarios are discussed.

Download full-text PDF

Source
http://dx.doi.org/10.1080/00221309.2011.604365DOI Listing

Publication Analysis

Top Keywords

size estimates
8
multiple trials
8
multiple items
8
trials
6
accuracy size
4
estimates published
4
published psychological
4
psychological experiments
4
experiments involving
4
multiple
4

Similar Publications

Accurate models for predicting drop dynamics, such as maximum drop departure sizes, are crucial for estimating heat transfer rates during condensation on superhydrophobic (SH) surfaces. Previous studies have focused on examining the heat transfer rates for SH surfaces under the influence of gravity or vapor flowing over the surface. This study investigates the impact of surface solid fraction and texture scale on drop mobility in a condensing environment with a humid air flow.

View Article and Find Full Text PDF

Long, identical haplotypes shared between pairs of individuals, known as identity-by-descent (IBD) segments, result from recently shared co-ancestry. Various methods have been developed to utilize IBD sharing for demographic inference in contemporary DNA data. Recent methodological advances have extended the screening for IBD segments to ancient DNA (aDNA) data, making demographic inference based on IBD also possible for aDNA.

View Article and Find Full Text PDF

Health Care Spending Increases and Value in South Korea.

JAMA Health Forum

January 2025

Shorenstein Asia-Pacific Research Center, Stanford University, Stanford, California.

Importance: Health care spending in South Korea (hereafter Korea) nearly doubled from 2010 to 2019. However, little is known about the drivers and effectiveness of these spending increases in terms of changes in disability-adjusted life-years (DALYs).

Objectives: To evaluate the factors contributing to changes in health care spending and DALYs and estimate the value of health care spending from 2010 to 2019 in Korea.

View Article and Find Full Text PDF

Sample Size Adjustment in Sequential Multiple Assignment Randomized Trials.

Stat Med

February 2025

Department of Biostatistics and Computational Biology, University of Rochester, Rochester, NY.

Clinical trials are often designed based on limited information about effect sizes and precision parameters with risks of underpowered studies. This is more problematic for SMARTs where strategy effects are based on sequences of treatments. Sample size adjustment offers flexibility through re-estimating sample size during the trial to ensure adequate power at the final analysis.

View Article and Find Full Text PDF

Bioequivalence Design With Sampling Distribution Segments.

Stat Med

February 2025

Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ontario, Canada.

In bioequivalence design, power analyses dictate how much data must be collected to detect the absence of clinically important effects. Power is computed as a tail probability in the sampling distribution of the pertinent test statistics. When these test statistics cannot be constructed from pivotal quantities, their sampling distributions are approximated via repetitive, time-intensive computer simulation.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!