Simulation studies are widely used for evaluating the performance of statistical methods in psychology. However, the quality of simulation studies can vary widely in terms of their design, execution, and reporting. In order to assess the quality of typical simulation studies in psychology, we reviewed 321 articles published in in 2021 and 2022, among which 100/321 = 31.2% report a simulation study. We find that many articles do not provide complete and transparent information about key aspects of the study, such as justifications for the number of simulation repetitions, Monte Carlo uncertainty estimates, or code and data to reproduce the simulation studies. To address this problem, we provide a summary of the ADEMP (aims, data-generating mechanism, estimands and other targets, methods, performance measures) design and reporting framework from Morris et al. (2019) adapted to simulation studies in psychology. Based on this framework, we provide ADEMP-PreReg, a step-by-step template for researchers to use when designing, potentially preregistering, and reporting their simulation studies. We give formulae for estimating common performance measures, their Monte Carlo standard errors, and for calculating the number of simulation repetitions to achieve a desired Monte Carlo standard error. Finally, we give a detailed tutorial on how to apply the ADEMP framework in practice using an example simulation study on the evaluation of methods for the analysis of pre-post measurement experiments. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7616844PMC
http://dx.doi.org/10.1037/met0000695DOI Listing

Publication Analysis

Top Keywords

simulation studies
28
monte carlo
12
simulation
11
reporting simulation
8
studies psychology
8
simulation study
8
number simulation
8
simulation repetitions
8
performance measures
8
carlo standard
8

Similar Publications

The widespread use of pesticides, including diazinon, poses an increased risk of environmental pollution and detrimental effects on biodiversity, food security, and water resources. In this study, we investigated the impact of Potentially Toxic Elements (PTE) including Zn, Cd, V, and Mn on the degradation of diazinon in three different soils. We investigated the capability and performance of four machine learning models to predict residual pesticide concentration, including adaptive neuro-fuzzy inference system (ANFIS), support vector regression (SVR), radial basis function (RBF), and multi-layer perceptron (MLP).

View Article and Find Full Text PDF

Systemic bile acid homeostasis plays an important role in human health. In this study, a physiologically based kinetic (PBK) model that includes microbial bile acid deconjugation and intestinal bile acid reuptake via the apical sodium-dependent bile acid transporter (ASBT) was applied to predict the systemic plasma bile acid concentrations in human upon oral treatment with the antibiotic tobramycin. Tobramycin was previously shown to inhibit intestinal deconjugation and reuptake of bile acids and to affect bile acid homeostasis upon oral exposure of rats.

View Article and Find Full Text PDF

Quantitative evaluation of the efficacy and safety of first-line systemic therapies for advanced hepatocellular carcinoma.

Eur J Clin Pharmacol

December 2024

Center for Pharmacometrics, Institute of Interdisciplinary Integrative Medicine Research, Shanghai University of Traditional Chinese Medicine, No.1200 Cailun Road, Shanghai, 201203, China.

Objectives: This study aimed to quantitatively evaluate the efficacy and safety of first-line systemic therapies for treating advanced hepatocellular carcinoma (aHCC).

Methods: The study included clinical trials of first-line systemic therapies for aHCC since the approval of sorafenib in 2007. Hazard function models were used to describe changes in overall survival (OS) and progression-free survival (PFS) over time.

View Article and Find Full Text PDF

Machine Learning Boosted Entropy-Engineered Synthesis of CuCo Nanometric Solid Solution Alloys for Near-100% Nitrate-to-Ammonia Selectivity.

ACS Appl Mater Interfaces

December 2024

Key Laboratory of Synthetic and Biological Colloids, Ministry of Education, School of Chemical and Material Engineering, Jiangnan University, 214122 Jiangsu, China.

Nanometric solid solution alloys are utilized in a broad range of fields, including catalysis, energy storage, medical application, and sensor technology. Unfortunately, the synthesis of these alloys becomes increasingly challenging as the disparity between the metal elements grows, due to differences in atomic sizes, melting points, and chemical affinities. This study utilized a data-driven approach incorporating sample balancing enhancement techniques and multilayer perceptron (MLP) algorithms to improve the model's ability to handle imbalanced data, significantly boosting the efficiency of experimental parameter optimization.

View Article and Find Full Text PDF

Glimepiride (GLM) is one of the potential antidiabetic drugs used in clinics for a long time. It is currently used in combination with metformin along with other drugs, but has shown various complications in patients from long-term use. Thus, the hypothesis is to use a lower dose of GLM with a non-toxic class of flavonoid, naringin (NARN), for better therapy with minimal side-effects.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!