Publications by authors named "Marcel van Assen"

Article Synopsis
  • This study examined the effectiveness and reliability of study preregistration in psychology by analyzing 300 research studies to see how closely they followed their preregistered plans.
  • The findings revealed that many preregistrations lacked essential methodological details and frequently deviated from their original plans, which suggests that research biases are still possible.
  • To enhance the accuracy and utility of preregistration, the authors recommend improved training for researchers, more detailed registration templates, and better transparency in reporting deviations.
View Article and Find Full Text PDF

Background: Neuropsychiatric symptoms are a robust risk factor for caregiver burden in family dementia caregivers. By grouping these symptoms, clinical interpretations regarding neuropsychiatric symptoms may facilitated because different groups of symptoms may require a different approach for intervention, thereby reducing caregiver burden.

Objective: As clustering of neuropsychiatric symptoms could be clinically relevant, we aimed to explore the effects of these clusters on burden in family dementia caregivers.

View Article and Find Full Text PDF

Self-report scales are widely used in psychology to compare means in latent constructs across groups, experimental conditions, or time points. However, for these comparisons to be meaningful and unbiased, the scales must demonstrate measurement invariance (MI) across compared time points or (experimental) groups. MI testing determines whether the latent constructs are measured equivalently across groups or time, which is essential for meaningful comparisons.

View Article and Find Full Text PDF

Objective: To examine the associations between individual chronic diseases and multidimensional frailty comprising physical, psychological, and social frailty.

Methods: Dutch individuals (N = 47,768) age ≥ 65 years completed a general health questionnaire sent by the Public Health Services (response rate of 58.5 %), including data concerning self-reported chronic diseases, multidimensional frailty, and sociodemographic characteristics.

View Article and Find Full Text PDF

Preregistration has gained traction as one of the most promising solutions to improve the replicability of scientific effects. In this project, we compared 193 psychology studies that earned a Preregistration Challenge prize or preregistration badge to 193 related studies that were not preregistered. In contrast to our theoretical expectations and prior research, we did not find that preregistered studies had a lower proportion of positive results (Hypothesis 1), smaller effect sizes (Hypothesis 2), or fewer statistical errors (Hypothesis 3) than non-preregistered studies.

View Article and Find Full Text PDF

Is peer sanctioning a sustainable solution to the problem of human cooperation? We conducted an exact multilab replication ( = 1,008; 7 labs × 12 groups × 12 participants) of an experiment by Gürerk, Irlenbusch, and Rockenbach published in in 2006 (Gürerk Ö, Irlenbusch B, Rockenbach B. The competitive advantage of sanctioning institutions. 2006.

View Article and Find Full Text PDF

Employing two vignette studies, we examined how psychology researchers interpret the results of a set of four experiments that all test a given theory. In both studies, we found that participants' belief in the theory increased with the number of statistically significant results, and that the result of a direct replication had a stronger effect on belief in the theory than the result of a conceptual replication. In Study 2, we additionally found that participants' belief in the theory was lower when they assumed the presence of p-hacking, but that belief in the theory did not differ between preregistered and non-preregistered replication studies.

View Article and Find Full Text PDF

The aim is to explore the trajectory of caregiver burden and how this relates to caregiver and contextual factors in community-dwelling dyads. At baseline, 201 family caregivers were included. The multidimensional construct of family caregiver burden and the effects of sense of competence, empathy, and quality of the relationship on this burden were assessed over 15 months using semi-structured interviews and questionnaires.

View Article and Find Full Text PDF

Background: Multidimensional frailty, including physical, psychological, and social components, is associated to disability, lower quality of life, increased healthcare utilization, and mortality. In order to prevent or delay frailty, more knowledge of its determinants is necessary; one of these determinants is lifestyle. The aim of this study is to determine the association between lifestyle factors smoking, alcohol use, nutrition, physical activity, and multidimensional frailty.

View Article and Find Full Text PDF

Background: Although cognitive behavioral therapy (CBT) is effective in the treatment of anxiety disorders, few evidence-based alternatives exist. Autonomy enhancing treatment (AET) aims to decrease the vulnerability for anxiety disorders by targeting underlying autonomy deficits and may therefore have similar effects on anxiety as CBT, but yield broader effects.

Methods: A multicenter cluster-randomized clinical trial was conducted including 129 patients with DSM-5 anxiety disorders, on average 33.

View Article and Find Full Text PDF

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

View Article and Find Full Text PDF

Researchers face many, often seemingly arbitrary, choices in formulating hypotheses, designing protocols, collecting data, analyzing data, and reporting results. Opportunistic use of "researcher degrees of freedom" aimed at obtaining statistical significance increases the likelihood of obtaining and publishing false-positive results and overestimated effect sizes. Preregistration is a mechanism for reducing such degrees of freedom by specifying designs and analysis plans before observing the research outcomes.

View Article and Find Full Text PDF

In this meta-study, we analyzed 2442 effect sizes from 131 meta-analyses in intelligence research, published from 1984 to 2014, to estimate the average effect size, median power, and evidence for bias. We found that the average effect size in intelligence research was a Pearson's correlation of 0.26, and the median sample size was 60.

View Article and Find Full Text PDF

Objective: To predict mortality with the Tilburg Frailty Indicator (TFI) in a sample of community-dwelling older people, using a follow-up of 7 years.

Design: Longitudinal.

Setting And Participants: 479 Dutch community-dwelling people aged 75 years or older.

View Article and Find Full Text PDF

In this preregistered study, we investigated whether the statistical power of a study is higher when researchers are asked to make a formal power analysis before collecting data. We compared the sample size descriptions from two sources: (i) a sample of pre-registrations created according to the guidelines for the Center for Open Science Preregistration Challenge (PCRs) and a sample of institutional review board (IRB) proposals from Tilburg School of Behavior and Social Sciences, which both include a recommendation to do a formal power analysis, and (ii) a sample of pre-registrations created according to the guidelines for Open Science Framework Standard Pre-Data Collection Registrations (SPRs) in which no guidance on sample size planning is given. We found that PCRs and IRBs (72%) more often included sample size decisions based on power analyses than the SPRs (45%).

View Article and Find Full Text PDF

We examined the evidence for heterogeneity (of effect sizes) when only minor changes to sample population and settings were made between studies and explored the association between heterogeneity and average effect size in a sample of 68 meta-analyses from 13 preregistered multilab direct replication projects in social and cognitive psychology. Among the many examined effects, examples include the Stroop effect, the "verbal overshadowing" effect, and various priming effects such as "anchoring" effects. We found limited heterogeneity; 48/68 (71%) meta-analyses had nonsignificant heterogeneity, and most (49/68; 72%) were most likely to have zero to small heterogeneity.

View Article and Find Full Text PDF

To determine the reproducibility of psychological meta-analyses, we investigated whether we could reproduce 500 primary study effect sizes drawn from 33 published meta-analyses based on the information given in the meta-analyses, and whether recomputations of primary study effect sizes altered the overall results of the meta-analysis. Results showed that almost half (k = 224) of all sampled primary effect sizes could not be reproduced based on the reported information in the meta-analysis, mostly because of incomplete or missing information on how effect sizes from primary studies were selected and computed. Overall, this led to small discrepancies in the computation of mean effect sizes, confidence intervals and heterogeneity estimates in 13 out of 33 meta-analyses.

View Article and Find Full Text PDF

Autonomy-enhancing treatment (AET) is a person-centered, gender-sensitive treatment, targeting transdiagnostic personal autonomy deficits. The current study was set up as a first pilot randomized controlled trial (RCT) to investigate the preliminary efficacy of AET. Earlier small non-controlled plots showed AET to be feasible and acceptable.

View Article and Find Full Text PDF

Publication bias is a substantial problem for the credibility of research in general and of meta-analyses in particular, as it yields overestimated effects and may suggest the existence of non-existing effects. Although there is consensus that publication bias exists, how strongly it affects different scientific literatures is currently less well-known. We examined evidence of publication bias in a large-scale data set of primary studies that were included in 83 meta-analyses published in Psychological Bulletin (representing meta-analyses from psychology) and 499 systematic reviews from the Cochrane Database of Systematic Reviews (CDSR; representing meta-analyses from medicine).

View Article and Find Full Text PDF

We examined the percentage of p values (.05 < p ≤ .10) reported as marginally significant in 44,200 articles, across nine psychology disciplines, published in 70 journals belonging to the American Psychological Association between 1985 and 2016.

View Article and Find Full Text PDF

The effect sizes of studies included in a meta-analysis do often not share a common true effect size due to differences in for instance the design of the studies. Estimates of this so-called between-study variance are usually imprecise. Hence, reporting a confidence interval together with a point estimate of the amount of between-study variance facilitates interpretation of the meta-analytic results.

View Article and Find Full Text PDF

One of the main goals of meta-analysis is to test for and estimate the heterogeneity of effect sizes. We examined the effect of publication bias on the test and assessments of heterogeneity as a function of true heterogeneity, publication bias, true effect size, number of studies, and variation of sample sizes. The present study has two main contributions and is relevant to all researchers conducting meta-analysis.

View Article and Find Full Text PDF

Analytical sociology explains macro-level outcomes by referring to micro-level behaviors, and its hypotheses thus take macro-level entities (e.g. groups) as their units of analysis.

View Article and Find Full Text PDF

Background: Maternal psychological distress during pregnancy is related to adverse child behavioral and emotional outcomes later in life, such as ADHD and anxiety/depression. The underlying mechanisms for this, however, are still largely unknown. The hypothalamic-pituitary-adrenal (HPA)-axis, with its most important effector hormone cortisol, has been proposed as a mechanism, but results have been inconsistent.

View Article and Find Full Text PDF

Purpose: This study aimed to determine the predictive value of the Brazilian Tilburg Frailty Indicator (TFI) for adverse health outcomes (falls, hospitalization, disability and death), in a follow-up period of twelve months.

Methods: This longitudinal study was carried out with a sample of people using primary health care services in Rio de Janeiro, Brazil. At baseline the sample consisted of 963 people aged 60 years and older.

View Article and Find Full Text PDF