Real-time artificial intelligence predicts adverse outcomes in acute pancreatitis in the emergency department: Comparison with clinical decision rule.

Objective: Artificial intelligence (AI) prediction is increasingly used for decision making in health care, but its application for adverse outcomes in emergency department (ED) patients with acute pancreatitis (AP) is not well understood. This study aimed to clarify this aspect.

Methods: Data from 8274 ED patients with AP in three hospitals from 2009 to 2018 were analyzed. Demographic data, comorbidities, laboratory results, and adverse outcomes were included. Six algorithms were evaluated, and the one with the highest area under the curve (AUC) was implemented into the hospital information system (HIS) for real-time prediction. Predictive accuracy was compared between the AI model and Bedside Index for Severity in Acute Pancreatitis (BISAP).

Results: The mean ± SD age was 56.1 ± 16.7 years, with 67.7% being male. The AI model was successfully implemented in the HIS, with Light Gradient Boosting Machine (LightGBM) showing the highest AUC for sepsis (AUC 0.961) and intensive care unit (ICU) admission (AUC 0.973), and eXtreme Gradient Boosting (XGBoost) showing the highest AUC for mortality (AUC 0.975). Compared to BISAP, the AI model had superior AUC for sepsis (BISAP 0.785), ICU admission (BISAP 0.778), and mortality (BISAP 0.817).

Conclusions: The first real-time AI prediction model implemented in the HIS for predicting adverse outcomes in ED patients with AP shows favorable initial results. However, further external validation is needed to ensure its reliability and accuracy.