Assessing variability in results in systematic reviews of diagnostic studies.

BMC Med Res Methodol

Julius Center for Health Sciences and Primary Care, University Medical Center, Universiteitsweg 100, Utrecht, 3584 CG, The Netherlands.

Published: January 2016

Background: To describe approaches used in systematic reviews of diagnostic test accuracy studies for assessing variability in estimates of accuracy between studies and to provide guidance in this area.

Methods: Meta-analyses of diagnostic test accuracy studies published between May and September 2012 were systematically identified. Information on how the variability in results was investigated was extracted.

Results: Of the 53 meta-analyses included in the review, most (n=48; 91%) presented variability in diagnostic accuracy estimates visually either through forest plots or ROC plots and the majority (n=40; 75%) presented a test or statistical measure for the variability. Twenty-eight reviews (53%) tested for variability beyond chance using Cochran's Q test and 31 (58%) reviews quantified it with I(2). 7 reviews (13%) presented between-study variance estimates (τ(2)) from random effects models and 3 of these presented a prediction interval or ellipse to facilitate interpretation. Half of all the meta-analyses specified what was considered a significant amount of variability (n=24; 49%).

Conclusions: Approaches to assessing variability in estimates of accuracy varied widely between diagnostic test accuracy reviews and there is room for improvement. We provide initial guidance, complemented by an overview of the currently available approaches.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4714528PMC
http://dx.doi.org/10.1186/s12874-016-0108-4DOI Listing

Publication Analysis

Top Keywords

assessing variability
12
diagnostic test
12
test accuracy
12
accuracy studies
12
systematic reviews
8
reviews diagnostic
8
variability estimates
8
estimates accuracy
8
variability
7
reviews
6

Similar Publications

Objectives: The inclusion of social drivers of health (SDOH) into predictive algorithms of health outcomes has potential for improving algorithm interpretation, performance, generalizability, and transportability. However, there are limitations in the availability, understanding, and quality of SDOH variables, as well as a lack of guidance on how to incorporate them into algorithms when appropriate to do so. As such, few published algorithms include SDOH, and there is substantial methodological variability among those that do.

View Article and Find Full Text PDF

In this cross-sectional analysis, we explored how fluctuations in glycemic levels impact executive functions and psychosocial outcomes in patients with type 2 diabetes mellitus (T2DM). The goal was to understand the relationship between glycemic control and both neuropsychological and psychosocial health. We stratified participants into well-controlled and poorly controlled groups based on glycated hemoglobin (HbA1c) levels and variability, including a healthy control group for comparison.

View Article and Find Full Text PDF

Background: Statistics Canada routinely collects information on functional health and related concepts. Recently, the Washington Group on Disability Statistics (WG) measure of disability has been introduced to the Canadian Community Health Survey (CCHS). The WG measure is used as a tool for developing internationally comparable data on disability.

View Article and Find Full Text PDF

Background: Timing of treatment of aortic stenosis (AS) is of key importance. AS severity is currently determined by transthoracic echocardiography (TTE) with a main focus on mean trans-aortic gradients. However, echocardiography has its limitations.

View Article and Find Full Text PDF

Background: The prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, time-consuming, and invasive, hindering patient compliance and the accessibility of these tests. Therefore, exploring a more cost-effective, efficient, and noninvasive method to aid clinicians in detecting MCI is necessary.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!