Diverging Conclusions from the Same Meta-Analysis in Drug Safety: Source of Data (Primary Versus Secondary) Takes a Toll.

Introduction: Meta-analyses of observational studies represent an important tool for assessing efficacy and safety in the pharmacoepidemiologic field. The data from the individual studies are either primary (i.e., collected through interviews or self-administered questionnaires) or secondary (i.e., collected from databases that were established for other purposes). So far, the origin of the data (primary vs. secondary) has not been systematically assessed as a source of heterogeneity in pharmacoepidemiologic meta-analyses.

Objective: The aim was to assess the impact of considering the source of exposure data as a criterion in sensitivity and subgroup analysis on the conclusions of drug safety meta-analyses.

Methods: We selected meta-analyses published between 2013 and 2015 in which the intake of frequently used over-the-counter medicines was either the main exposure or a concomitant treatment and the outcome had short latency and induction periods. We stratified the results by origin of data (primary vs. secondary) and compared the new results to those presented originally in the meta-analyses.

Results: We used four meta-analyses that fulfilled our criteria of inclusion. The results were selective serotonin reuptake inhibitors and upper gastrointestinal bleeding: original estimate odds ratio (OR) = 1.71 [95% confidence interval (CI) 1.44-2.04], OR primary data = 1.19 (95% CI 0.90-1.58), OR secondary data = 1.81 (95% CI 1.50-2.17); proton pump inhibitors and cardiac events: original estimate hazard ratio (HR) = 1.35 (95% CI 1.18-1.54), HR primary data = 1.05 (95% CI 0.87-1.26), HR secondary data = 1.43 (95% CI 1.23-1.66); non-aspirin non-steroidal anti-inflammatory drugs and myocardial infarction: original estimate risk ratio (RR) = 1.08 (95% CI 0.95-1.22), RR primary data = 0.57 (95% CI 0.34-0.96), RR secondary data = 1.15 (95% CI 1.03-1.28); paracetamol during pregnancy and childhood asthma: original estimate OR = 1.32 (95% CI 1.14-1.52), OR primary data = 1.23 (95% CI 1.06-1.42), OR secondary data = 1.53 (95% CI 1.33-1.75).

Conclusions: The results after stratification are considerably modified. It is crucial to explore the origin of the data, either primary or secondary, as a source of heterogeneity in pharmacoepidemiologic meta-analyses to avoid misleading conclusions.