Discriminative Accuracy of Physician and Nurse Predictions for Survival and Functional Outcomes 6 Months After an ICU Admission.

JAMA

Palliative and Advanced Illness Research (PAIR) Center, University of Pennsylvania Perelman School of Medicine, Philadelphia5Department of Biostatistics and Epidemiology, University of Pennsylvania Perelman School of Medicine, Philadelphia6Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia11Division of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia12Department of Medical Ethics and Health Policy, University of Pennsylvania, Philadelphia.

Published: June 2017

Importance: Predictions of long-term survival and functional outcomes influence decision making for critically ill patients, yet little is known regarding their accuracy.

Objective: To determine the discriminative accuracy of intensive care unit (ICU) physicians and nurses in predicting 6-month patient mortality and morbidity, including ambulation, toileting, and cognition.

Design, Setting, And Participants: Prospective cohort study conducted in 5 ICUs in 3 hospitals in Philadelphia, Pennsylvania, and enrolling patients who spent at least 3 days in the ICU from October 2013 until May 2014 and required mechanical ventilation, vasopressors, or both. These patients' attending physicians and bedside nurses were also enrolled. Follow-up was completed in December 2014.

Main Outcomes And Measures: ICU physicians' and nurses' binary predictions of in-hospital mortality and 6-month outcomes, including mortality, return to original residence, ability to toilet independently, ability to ambulate up 10 stairs independently, and ability to remember most things, think clearly, and solve day-to-day problems (ie, normal cognition). For each outcome, physicians and nurses provided a dichotomous prediction and rated their confidence in that prediction on a 5-point Likert scale. Outcomes were assessed via interviews with surviving patients or their surrogates at 6 months. Discriminative accuracy was measured using positive and negative likelihood ratios (LRs), C statistics, and other operating characteristics.

Results: Among 340 patients approached, 303 (89%) consented (median age, 62 years [interquartile range, 53-71]; 57% men; 32% African American); 6-month follow-up was completed for 299 (99%), of whom 169 (57%) were alive. Predictions were made by 47 physicians and 128 nurses. Physicians most accurately predicted 6-month mortality (positive LR, 5.91 [95% CI, 3.74-9.32]; negative LR, 0.41 [95% CI, 0.33-0.52]; C statistic, 0.76 [95% CI, 0.72-0.81]) and least accurately predicted cognition (positive LR, 2.36 [95% CI, 1.36-4.12]; negative LR, 0.75 [95% CI, 0.61-0.92]; C statistic, 0.61 [95% CI, 0.54-0.68]). Nurses most accurately predicted in-hospital mortality (positive LR, 4.71 [95% CI, 2.94-7.56]; negative LR, 0.61 [95% CI, 0.49-0.75]; C statistic, 0.68 [95% CI, 0.62-0.74]) and least accurately predicted cognition (positive LR, 1.50 [95% CI, 0.86-2.60]; negative LR, 0.88 [95% CI, 0.73-1.06]; C statistic, 0.55 [95% CI, 0.48-0.62]). Discriminative accuracy was higher when physicians and nurses were confident about their predictions (eg, for physicians' confident predictions of 6-month mortality: positive LR, 33.00 [95% CI, 8.34-130.63]; negative LR, 0.18 [95% CI, 0.09-0.35]; C statistic, 0.90 [95% CI, 0.84-0.96]). Compared with a predictive model including objective clinical variables, a model that also included physician and nurse predictions had significantly higher discriminative accuracy for in-hospital mortality, 6-month mortality, and return to original residence (P < .01 for all).

Conclusions And Relevance: ICU physicians' and nurses' discriminative accuracy in predicting 6-month outcomes of critically ill patients varied depending on the outcome being predicted and confidence of the predictors. Further research is needed to better understand how clinicians derive prognostic estimates of long-term outcomes.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5710341PMC
http://dx.doi.org/10.1001/jama.2017.4078DOI Listing

Publication Analysis

Top Keywords

discriminative accuracy
20
accurately predicted
16
[95%
15
physicians nurses
12
in-hospital mortality
12
6-month mortality
12
mortality positive
12
physician nurse
8
nurse predictions
8
survival functional
8

Similar Publications

Dimensions of the pelvic and skull bones are known to be sexually dimorphic in various population groups. The recovery of these bones is potentially beneficial in estimating the sex in forensic cases. Since both bones are not always available for forensic analysis, standards for sex estimation must be established for other bones of the postcranial skeleton.

View Article and Find Full Text PDF

Objective: To assess and compare the diagnostic accuracy of radiologist, MR findings, and radiomics-clinical models in the diagnosis of placental implantation disorders.

Methods: Retrospective collection of MR images from patients suspected of having placenta accreta spectrum (PAS) was conducted across three institutions: Institution I (n = 505), Institution II (n = 67), and Institution III (n = 58). Data from Institution I were utilized to form a training set, while data from Institutions II and III served as an external test set.

View Article and Find Full Text PDF

Rapid and accurate methods for tracing and identifying the origin of lamb are crucial for ensuring food authenticity and quality. This study developed a precise traceability method to determine the origin of lamb by integrating rapid evaporative ionization mass spectrometry (REIMS) with multivariate statistical analysis. Lamb samples from Xilin Gol, Ordos, and Hulun Buir ranches were identified by REIMS fingerprinting within 1 min.

View Article and Find Full Text PDF

Objective: To develop and validate an explainable machine learning (ML) model predicting the risk of hemorrhagic transformation (HT) after intravenous thrombolysis.

Methods: We retrospectively enrolled patients who received intravenous tissue plasminogen activator (IV-tPA) thrombolysis within 4.5 h after symptom onset to form the original modeling cohort.

View Article and Find Full Text PDF

Background: Texture analysis has the potential to deliver quantitative imaging markers. Patients receiving computed tomography (CT)-guided percutaneous bone biopsies could be characterized using texture analysis derived from CT. Especially for breast cancer (BC) patients, it could be crucial to better predict the outcome of the biopsy to better reflect the immunohistochemistry status of the tumor.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!