AI Article Synopsis
Article Abstract
Background: Prediction modeling studies often have methodological limitations, which may compromise model performance in new patients and settings. We aimed to examine the relation between methodological quality of model development studies and their performance at external validation.
Methods: We systematically searched for externally validated multivariable prediction models that predict functional outcome following moderate or severe traumatic brain injury. Risk of bias and applicability of development studies was assessed with the Prediction model Risk Of Bias Assessment Tool (PROBAST). Each model was rated for its presentation with sufficient detail to be used in practice. Model performance was described in terms of discrimination (AUC), and calibration. Delta AUC (dAUC) was calculated to quantify the percentage change in discrimination between development and validation for all models. Generalized estimation equations (GEE) were used to examine the relation between methodological quality and dAUC while controlling for clustering.
Results: We included 54 publications, presenting ten development studies of 18 prediction models, and 52 external validation studies, including 245 unique validations. Two development studies (four models) were found to have low risk of bias (RoB). The other eight publications (14 models) showed high or unclear RoB. The median dAUC was positive in low RoB models (dAUC 8%, [IQR - 4% to 21%]) and negative in high RoB models (dAUC - 18%, [IQR - 43% to 2%]). The GEE showed a larger average negative change in discrimination for high RoB models (- 32% (95% CI: - 48 to - 15) and unclear RoB models (- 13% (95% CI: - 16 to - 10)) compared to that seen in low RoB models.
Conclusion: Lower methodological quality at model development associates with poorer model performance at external validation. Our findings emphasize the importance of adherence to methodological principles and reporting guidelines in prediction modeling studies.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9068255 | PMC |
| http://dx.doi.org/10.1186/s41512-022-00122-0 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Bromocriptine Versus Levodopa and other treatments in Parkinson's Disease: an updated Meta-analysis Involving more than 4000 patients across 12 randomized clinical trials.
Acta Neurol Belg
December 2024
Department of Epidemiology and Biostatistics, Faculty of Medicine, Kurdistan University of Medical Sciences, Sanandaj, Iran.
Objectives: The purpose of this meta-analysis was to conduct a comparative study by systematically examining and analyzing trials that studied the impacts of levodopa and bromocriptine, either separately or together, in treating Parkinson's disease (PD).
Methods: An extensive literature search was conducted across PubMed (Medline), Scopus, and Web of Science databases, using targeted keywords for studies published up to October 2024. The methodological quality of included RCTs was assessed with the Cochrane Risk of Bias 2 (RoB 2) tool, and bias evaluation was performed using RevMan (version 5).
The relationship between muscle mass changes and protein or energy intake in critically ill children: A systematic review and meta-analysis.
JPEN J Parenter Enteral Nutr
December 2024
Edge Hill University, Ormskirk, UK.
Survivorship after pediatric critical illness is high in developed countries, but many suffer physical morbidities afterwards. The increasing focus on follow-up after critical illness has led to more pediatric studies reporting muscle mass changes (using ultrasound), albeit with different results. A systematic literature review was undertaken examining muscle mass changes, assessed by ultrasound of the quadriceps femoris muscle in children who are critically ill.
View Article and Find Full Text PDFThe impact of psoriatic arthritis on quality of life: a systematic review.
Ther Adv Musculoskelet Dis
December 2024
Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, Windmill Road, Oxford OX3 7HE, UK.
Background: Psoriatic arthritis (PsA) is a chronic inflammatory condition that can affect individuals of all ages. Patients may experience a range of physical and psychological issues.
Objective: To examine the impact of PsA on an individual's quality of life (QoL) and physical function.
Validation of selection signatures for coat color in the Podolica Italiana gray cattle breed.
Front Genet
December 2024
Dipartimento di Bioscienze, Biotecnologie e Ambiente, Università degli Studi di Bari "Aldo Moro", Bari, Italy.
Taurine and indicine gray cattle represent relevant livestock resources in many countries of the world. A gray coat color and pigmented skin, which are common in most of the gray cattle breeds, have been demonstrated to confer better adaptation to solar radiation and thermal stresses. In a previous study adopting the F-outlier approach with BayeScan v2.
View Article and Find Full Text PDFApathy Associated with Alzheimer's Disease.
Curr Alzheimer Res
December 2024
Department of Neuroscience, Heilongjiang University of Chinese Medicine, Harbin, Heilongjiang, China.
Introduction/objective: Apathy is a multidimensional and complex disease that is the primary neuropsychiatric symptom among those diagnosed with Alzheimer's disease (AD). Yet, apathy in AD is sometimes underestimated.
Methods: A systematic literature review was conducted using databases such as PubMed, Scopus, and Web of Science.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!