Tempest in a teacup: An analysis of p-Hacking in organizational research.

We extend questionable research practices (QRPs) research by conducting a robust, large-scale analysis of p-hacking in organizational research. We leverage a manually curated database of more than 1,000,000 correlation coefficients and sample sizes, with which we calculate exact p-values. We test for the prevalence and magnitude of p-hacking across the complete database as well as various subsets of the database according to common bivariate relation types in the organizational literature (e.

A meta-analysis of experienced incivility and its correlates: Exploring the dual path model of experienced workplace incivility.

The present study proposes and examines a theoretical Dual Path Model of Experienced Workplace Incivility using meta-analytic relationships (k = 246; N = 145, 008) between experienced incivility and frequent correlates. The stress-induced mechanism was supported with perceived stress mediating the meta-analytical relationship between experienced incivility and occupational health (i.e.

The Happy Culture: A Theoretical, Meta-Analytic, and Empirical Review of the Relationship Between Culture and Wealth and Subjective Well-Being.

Do cultural values enhance financial and subjective well-being (SWB)? Taking a multidisciplinary approach, we meta-analytically reviewed the field, found it thinly covered, and focused on individualism. In counter, we collected a broad array of individual-level data, specifically an Internet sample of 8,438 adult respondents. Individual SWB was most strongly associated with cultural values that foster relationships and social capital, which typically accounted for more unique variance in life satisfaction than an individual's salary.

Response to Comment on "Estimating the reproducibility of psychological science".

Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data.

Correlational effect size benchmarks.

Effect size information is essential for the scientific enterprise and plays an increasingly central role in the scientific process. We extracted 147,328 correlations and developed a hierarchical taxonomy of variables reported in Journal of Applied Psychology and Personnel Psychology from 1980 to 2010 to produce empirical effect size benchmarks at the omnibus level, for 20 common research domains, and for an even finer grained level of generality. Results indicate that the usual interpretation and classification of effect sizes as small, medium, and large bear almost no resemblance to findings in the field, because distributions of effect sizes exhibit tertile partitions at values approximately one-half to one-third those intuited by Cohen (1988).

Congruency effects in the letter search task: semantic activation in the absence of priming.

Semantic priming is typically eliminated when participants perform a letter search on the prime, suggesting that semantic activation is conditional upon one's attentional goals. However, in such studies, semantic activation (or the lack thereof) is not measured during the letter search task itself but, instead, is inferred on the basis of the responses given to a later target. In the present study, direct online evidence for semanticactivation was tested using words whose meaning should bias either a positive or a negative response (e.