Critical Appraisal of the Quality of Publications in Hepatobiliary and Pancreatic Surgery Research Using the American College of Surgeons NSQIP Database.

Background: The use of the American College of Surgeons (ACS) NSQIP has increased in hepatobiliary and pancreatic surgery (HPB) research as it provides access to high-quality surgical outcome data on a national scale. Using the ACS NSQIP database, this study examined the methodologic reporting of HPB publications.

Study Design: Web of Science core collection (all editions) was queried for all HPB studies using the ACS NSQIP database published between 2004 and 2022. In addition, a critical appraisal was performed using the JAMA Surgery checklist, Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement, and Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement.

Results: In total, 276 studies were included in the analysis. The median scores for the JAMA Surgery checklist, RECORD statement, and STROBE statement were 4 of 7 (interquartile range [IQR] 3 to 5), 3 of 10 (IQR 2 to 4), and 15 of 21 (IQR 13 to 17), respectively. The criteria with the highest rates of nonadherence were discussing competing risks, clear definitions of inclusion and exclusion criteria, unadjusted and adjusted outcomes, provision of supplementary data, and performing subgroup analyses. Additionally, when examining checklist fulfillment of hepatobiliary studies and pancreatic studies separately, pancreatic studies demonstrated significantly greater fulfillment of the STROBE statement checklist items.

Conclusions: Satisfactory reporting of methodology is present among HPB studies utilizing the ACS NSQIP database, with multiple opportunities for improvement. Areas for improved adherence include discussing competing risks, providing supplementary information, and performing appropriate subgroup analysis. Given the increasing role of large-scale databases in surgical research, enhanced commitment to reporting guidelines may advance HPB research and ensure quality reporting.