Introduction: Practice-Based Learning and Improvement, a core competency identified by the Accreditation Council for Graduate Medical Education, carries importance throughout a physician's career. Practice-Based Learning and Improvement is cultivated by a critical review of complications, yet methods to accurately identify complications are inadequate. Machine-learning algorithms show promise in improving identification of complications. We compare a manual-supplemented natural language processing (ms-NLP) methodology against a validated electronic morbidity and mortality (MM) database, the Morbidity and Mortality Adverse Event Reporting System (MARS) to understand the utility of NLP in MM review.

Methods: The number and severity of complications were compared between MARS and ms-NLP of surgical hospitalization discharge summaries among three academic medical centers. Clavien-Dindo (CD) scores were assigned to cases with identified complications and classified into minor (CD I-II) or major (CD III-IV) harm.

Results: Of 7774 admissions, 987 cases were identified to have 1659 complications by MARS and 1296 by ms-NLP. MARS identified 611 (62%) cases, whereas ms-NLP identified 670 (68%) cases. Less than one-third of cases (299, 30.3%) were detected by both methods. MARS identified a greater number of complications with major harm (457, 46.30%) than did ms-NLP (P < 0.0001).

Conclusions: Both a prospectively maintained MM database and ms-NLP review of discharge summaries fail to identify a significant proportion of postoperative complications and overlap 1/3 of the time. ms-NLP more frequently identifies cases with minor complications, whereas prospective voluntary reporting more frequently identifies major complications. The educational benefit of reporting and analysis of complication data may be supplemented by ms-NLP but not replaced by it at this time.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.jss.2022.10.075DOI Listing

Publication Analysis

Top Keywords

practice-based learning
12
learning improvement
12
morbidity mortality
12
natural language
8
language processing
8
cases identified
8
mars identified
8
complications
7
identified
6
ms-nlp
5

Similar Publications

Background: The six core competencies of ACGME - patient care (PC), medical knowledge (MK), systems-based practice (SBP), practice-based learning and improvement (PBLI), professionalism (PROF), and interpersonal and communication skills (ICS) - represent domains in which physicians must ultimately demonstrate competence. Although the ACGME's six core competencies have been applied in Taiwan with the milestone project, the application of the six core competences in the Family Medicine milestones for residency training have not yet been established.

Methods: We recruited 61 family medicine physicians from 25 hospitals from four major geographic areas for a Delphi round one survey and 72 physicians from 27 hospitals for a Delphi round two survey.

View Article and Find Full Text PDF

Proficiency-chasing and goalodicy: In prioritising checklists, are we gambling with the future of mental health nursing?

Nurse Educ Today

January 2025

School of Nursing and Midwifery, University of Central Lancashire, United Kingdom of Great Britain and Northern Ireland. Electronic address:

In this discussion paper, I take a critical approach to the use of standardised checklists in practice assessment documents as a valid method of assessing mental health nursing students in the UK. The game Bingo is applied here as a metaphor, highlighting the folly of using standardised cross-field checklists to assess mental health nursing students in practice. Such practices, I argue, amount to little more than a game of proficiency-chasing at the expense of seeking more meaningful learning experiences, especially where practice assessment documents currently prioritise physical health care skills above those required for successful mental health nursing.

View Article and Find Full Text PDF

Graduate perceptions of their interprofessional practice: Lessons for undergraduate training.

Afr J Prim Health Care Fam Med

December 2024

Division of Rural Health (Ukwanda), Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa; and, Department of Health Professions Education, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town.

Background:  Interprofessional education (IPE) during undergraduate training (UGT) is considered important for new graduates to collaborate inter-professionally. There are, however, well-documented workplace challenges that hinder their involvement in interprofessional collaborative practice (IPCP) such as professional hierarchy, poor role clarification and communication challenges.

Aim:  This article explores graduates' perceptions of the value rural undergraduate IPE had on their IPCP during their first year of work.

View Article and Find Full Text PDF

Building Family Medicine Research Through Community Engagement: Leveraging Federal Awards to Develop Infrastructure.

J Am Board Fam Med

January 2025

From the Department of Family Medicine and Community Health, Rutgers Health, 303 George Street, Matrix Plaza 1, Room 614, New Brunswick, NJ (AFT, JMF, MEJ, MP, MFC, EJ, SVH); New Jersey Alliance for Clinical and Translational Science, New Brunswick, NJ (AFT, DH, MEJ, SVH); Office of University-Community Partnerships, Rutgers University, Newark, NJ (DH); Department of Pediatrics, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ (MEJ); Rutgers Robert Wood Johnson Medical School, Rutgers Institute for Translational Medicine and Science, New Brunswick, NJ, USA (SVH).

Many academic departments and programs struggle with the challenge of how to begin a meaningful research program. A useful place to start is with the work they already are doing in communities. Using work in practices and other clinical venues as a springboard can build helpful relationships that can catalyze research and build infrastructure that matters to family medicine clinicians, researchers, and the communities they serve.

View Article and Find Full Text PDF

Background: Unhealthy alcohol use is a leading cause of preventable mortality and a risk factor for an array of social and health problems. The Intervention in Small primary care Practices to Implement Reduction in unhealthy alcohol use (INSPIRE) study is part of a nationwide campaign to improve the identification and treatment of patients engaging in unhealthy alcohol use.

Methods: We conducted a single arm, pragmatic study consisting of seventeen primary care practices in the Chicago metropolitan area, Wisconsin, and California across two waves with a 6-month latent period, a 12-month intervention period, followed by a 6-month sustainability period.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!