Multiverse analysis is an approach to data analysis in which all "reasonable" analytic decisions are evaluated in parallel and interpreted collectively, in order to foster robustness and transparency. However, specifying a multiverse is demanding because analysts must manage myriad variants from a cross-product of analytic decisions, and the results require nuanced interpretation. We contribute Baba: an integrated domain-specific language (DSL) and visual analysis system for authoring and reviewing multiverse analyses. With the Boba DSL, analysts write the shared portion of analysis code only once, alongside local variations defining alternative decisions, from which the compiler generates a multiplex of scripts representing all possible analysis paths. The Boba Visualizer provides linked views of model results and the multiverse decision space to enable rapid, systematic assessment of consequential decisions and robustness, including sampling uncertainty and model fit. We demonstrate Boba's utility through two data analysis case studies, and reflect on challenges and design opportunities for multiverse analysis software.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1109/TVCG.2020.3028985 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Psychometric, pre-processing, and trial-type considerations in individual differences studies of EEG mid-frontal theta power and latency.
Int J Psychophysiol
March 2025
Department of Psychology, University of Utah, 380 S 1530 E BEH S 502, Salt Lake City, UT 84112, United States.
EEG mid-frontal theta-band activity (MFT; 4-8 Hz) is of considerable interest as a possible biomarker in translational research on cognitive control. However, because most of the MFT literature has focused on experimental within-subjects effects, the impact of particular data processing choices on individual difference analyses is not well understood. This study aimed to reduce that gap by examining the psychometric properties of different pipelines for measuring individual differences in MFT power and latency.
View Article and Find Full Text PDFAssessing the predictive value of peak alpha frequency for the sensitivity to pain.
Pain
March 2025
Department of Neurology and TUM-Neuroimaging Center, TUM School of Medicine and Health, Technical University of Munich (TUM), Munich, Germany.
Pain perception varies considerably between and within individuals. How the brain determines these variations has yet to be fully understood. The peak frequency of alpha oscillations has recently been shown to predict an individual's sensitivity to longer-lasting experimental and clinical pain.
View Article and Find Full Text PDFAssessing the balance between excitation and inhibition in chronic pain through the aperiodic component of EEG.
Elife
January 2025
Department of Neurology, TUM School of Medicine and Health, Technical University of Munich (TUM), Munich, Germany.
Chronic pain is a prevalent and debilitating condition whose neural mechanisms are incompletely understood. An imbalance of cerebral excitation and inhibition (E/I), particularly in the medial prefrontal cortex (mPFC), is believed to represent a crucial mechanism in the development and maintenance of chronic pain. Thus, identifying a non-invasive, scalable marker of E/I could provide valuable insights into the neural mechanisms of chronic pain and aid in developing clinically useful biomarkers.
View Article and Find Full Text PDFDifferential item functioning between English, German, and Spanish PROMIS® physical function ceiling items.
Qual Life Res
December 2024
Center for Patient-Centered Outcomes Research, Medizinische Klinik mit Schwerpunkt für Psychosomatik, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Charitéplatz 1, 10097, Berlin, Germany.
Article Synopsis
- The study evaluated the validity of German and Spanish translations of 35 new high-functioning items in the PROMIS Physical Function item bank by comparing responses from diverse samples in Argentina, Germany, and the U.S.
- Data was collected from 3601 participants, with equal distribution among language versions, and differential item functioning (DIF) was analyzed through a comprehensive multiverse analysis.
- Findings indicated that while some items showed consistent DIF across languages, its overall impact was minimal, and physical functioning scores were higher in Argentina compared to the U.S. and Germany, supporting the items' universal applicability across different populations.
Legacies of Hate: The Psychological Legacy of the Ku Klux Klan.
Pers Soc Psychol Bull
December 2024
Radboud University, Nijmegen, The Netherlands.
The second coming of the Ku Klux Klan popularized the Klan and its ideas in the early 1920s, terrorizing Black American, their allies, and others deemed un-American. This article investigates the extent to which the cultural legacy of racial hatred of the Klan has persisted over the years. We use data from large online databases, multiverse analyses, and spatial models to evaluate whether regions with more historical Klan activity show higher levels of modern-day racial bias, and more modern-day White Supremacist activity.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!