Model-implied simulation-based power estimation for correctly specified and distributionally misspecified models: Applications to nonlinear and linear structural equation models.

Behav Res Methods

Institute of Psychology, Department of Research Methods and Evaluation, Goethe University Frankfurt, Theodor-W.-Adorno-Platz 6, 60629, Frankfurt am Main, Germany.

Published: December 2024

Closed-form (asymptotic) analytical power estimation is only available for limited classes of models, requiring correct model specification for most applications. Simulation-based power estimation can be applied in almost all scenarios where data following the model can be estimated. However, a general framework for calculating the required sample sizes for given power rates is still lacking. We propose a new model-implied simulation-based power estimation (MSPE) method for the z-test that makes use of the asymptotic normality property of estimates of a wide class of estimators, the M-estimators, and give theoretical justification for the approach. M-estimators include maximum-likelihood, least squares estimates and limited information estimators, but also estimators used for misspecified models, hence, the new simulation-based power modeling method is widely applicable. The MSPE employs a parametric model to describe the relationship between power and sample size, which can then be used to determine the required sample size for a specified power rate. We highlight its performance in linear and nonlinear structural equation models (SEM) for correctly specified models and models under distributional misspecification. Simulation results suggest that the new power modeling method is unbiased and shows good performance with regard to root mean squared error and type I error rates for the predicted required sample sizes and predicted power rates, outperforming alternative approaches, such as the naïve approach of selecting a discrete selection of sample sizes with linear interpolation of power or simple logistic regression approaches. The MSPE appears to be a valuable tool to estimate power for models without an (asymptotic) analytical power estimation.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11525309PMC
http://dx.doi.org/10.3758/s13428-024-02507-zDOI Listing

Publication Analysis

Top Keywords

power estimation
20
simulation-based power
16
power
13
required sample
12
sample sizes
12
model-implied simulation-based
8
models
8
misspecified models
8
structural equation
8
equation models
8

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!