AI Article Synopsis

  • A large-scale study was conducted to evaluate the bias, precision, and timeliness of different designs in estimating vaccine safety events by comparing expected rates with observed rates post-vaccination.
  • The analysis revealed that using historical background rates to identify potential safety signals for vaccines was sensitive but often overestimated risks, showing high type 1 error (20%-100%) and low type 2 error (0%-20%).
  • Adjusting for factors like age and sex improved the accuracy but still left some systematic errors, while empirical calibration helped reduce type 1 error though at the expense of increasing type 2 error.

Article Abstract

Using real-world data and past vaccination data, we conducted a large-scale experiment to quantify bias, precision and timeliness of different study designs to estimate historical background (expected) compared to post-vaccination (observed) rates of safety events for several vaccines. We used negative (not causally related) and positive control outcomes. The latter were synthetically generated true safety signals with incident rate ratios ranging from 1.5 to 4. Observed vs. expected analysis using within-database historical background rates is a sensitive but unspecific method for the identification of potential vaccine safety signals. Despite good discrimination, most analyses showed a tendency to overestimate risks, with 20%-100% type 1 error, but low (0% to 20%) type 2 error in the large databases included in our study. Efforts to improve the comparability of background and post-vaccine rates, including age-sex adjustment and anchoring background rates around a visit, reduced type 1 error and improved precision but residual systematic error persisted. Additionally, empirical calibration dramatically reduced type 1 to nominal but came at the cost of increasing type 2 error.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8652333PMC
http://dx.doi.org/10.3389/fphar.2021.773875DOI Listing

Publication Analysis

Top Keywords

type error
16
historical background
12
bias precision
8
precision timeliness
8
vaccine safety
8
safety signals
8
background rates
8
reduced type
8
background
5
type
5

Similar Publications

We present the R package MIIVefa, designed to implement the MIIV-EFA algorithm. This algorithm explores and identifies the underlying factor structure within a set of variables. The resulting model is not a typical exploratory factor analysis (EFA) model because some loadings are fixed to zero and it allows users to include hypothesized correlated errors such as might occur with longitudinal data.

View Article and Find Full Text PDF

The effective reproduction number serves as a metric of population-wide, time-varying disease spread. During the early years of the COVID-19 pandemic, this metric was primarily derived from case data, which has varied in quality and representativeness due to changes in testing volume, test-seeking behavior, and resource constraints. Deriving nowcasting estimates from alternative data sources such as wastewater provides complementary information that could inform future public health responses.

View Article and Find Full Text PDF

Ex vivo imaging-based high content phenotyping of patients with rheumatoid arthritis.

EBioMedicine

December 2024

CeMM Research Centre for Molecular Medicine of the Austrian Academy of Sciences, Vienna, Austria; Centre for Physiology and Pharmacology, Medical University of Vienna; Vienna, Austria. Electronic address:

Background: High content imaging-based functional precision medicine approaches have been developed and successfully applied in the field of haemato-oncology. For rheumatoid arthritis (RA), treatment selection is still based on a trial-and-error principle, and biomarkers for patient stratification and drug response prediction are needed.

Methods: A high content, high throughput microscopy-based phenotyping pipeline for peripheral blood mononuclear cells (PBMCs) was developed, allowing for the quantification of cell type frequencies, cell type specific morphology and intercellular interactions from patients with RA (n = 65) and healthy controls (HC, n = 33).

View Article and Find Full Text PDF

Interpreting statistical significance in hominin dimorphism: Power and Type I error rates for resampling tests of univariate and missing-data multivariate size dimorphism estimation methods in the fossil record.

J Hum Evol

December 2024

Department of Anthropology, University at Albany (SUNY), 1400 Washington Avenue, Albany, NY 12222, USA; College of Fellows, Institute of Advanced Study, Durham University, Cosin's Hall, Palace Green, Durham, DH1 3RL, UK; Department of Anthropology, Durham University, Dawson Building, South Road, Durham, DH1 3LE, UK. Electronic address:

The degree of sexual size dimorphism in fossil hominins is important evidence for the evaluation of evolutionary hypotheses, but it is also difficult/impossible to measure directly. Multiple methods have been developed to estimate dimorphism in univariate and multivariate datasets, including when data are missing. This paper introduces 'dimorph', an R package that implements many of these methods and associated resampling-based significance tests and evaluates their performance in terms of Type I error rates and power.

View Article and Find Full Text PDF

Background: Dialysis Access (DA) stenosis impacts hemodialysis efficiency and patient health, necessitating exams for early lesion detection. Ultrasound is widely used due to its non-invasive, cost-effective nature. Assessing all patients in large hemodialysis facilities strains resources and relies on operator expertise.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!