Background: Patients and healthcare professionals extensively rely on the internet for medical information. Low-quality videos can significantly impact the patient-doctor relationship, potentially affecting consultation efficiency and decision-making process. Chat Generative Pre-Trained Transformer (ChatGPT) is an artificial intelligence application with the potential to improve medical reports, provide medical information, and supplement orthopedic knowledge acquisition. This study aimed to assess the ability of ChatGPT-4 to detect deficiencies in these videos, assuming it would be successful in identifying such deficiencies.

Materials And Methods: YouTube was searched for "rotator cuff surgery" and "rotator cuff surgery clinic" videos. A total of 90 videos were evaluated, with 40 included in the study after exclusions. Using the Google Chrome extension ''YouTube Summary with ChatGPT & Claude,'' transcripts of these videos were accessed. Two senior orthopedic surgeons and ChatGPT-4 evaluated the videos using the rotator cuff surgery YouTube score (RCSS) system and DISCERN criteria.

Results: ChatGPT-4's RCSS evaluations were comparable to those of the observers in 25% of instances, and 40% for DISCERN. The interobserver agreement between human observers and ChatGPT-4 was fair (AC1: 0.575 for DISCERN and AC1: 0.516 for RCSS). Even after correcting ChatGPT-4's incorrect answers, the agreement did not change significantly. ChatGPT-4 tended to give higher scores than the observers, particularly in sections related to anatomy, surgical technique, and indications for surgery.

Conclusion: The use of ChatGPT-4 as an observer in evaluating rotator cuff surgery-related videos and identifying deficiencies is not currently recommended. Future studies with trained ChatGPT models may address these deficiencies and enable ChatGPT to evaluate videos at a human observer level.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.jse.2024.04.021DOI Listing

Publication Analysis

Top Keywords

rotator cuff
12
cuff surgery
12
orthopedic surgeons
8
videos
8
"rotator cuff
8
cuff
5
chatgpt-4
5
chat-gpt assist
4
assist orthopedic
4
surgeons evaluating
4

Similar Publications

Mini-open transosseous repair with bursal augmentation improves outcomes in massive rotator cuff tears.

Sci Rep

January 2025

Department of Orthopedics and Traumatology, KasrAlAinyFacultyofMedicine, Cairo University, Al- Manial, Cairo, Egypt.

Treatment of Massive rotator cuff tears (MRCT) is difficult, with high rates of retears. Using biological augmentation in the form of the highly vascular subacromial bursa, was used to improve tendon healing. This work aimed to evaluate the results of arthroscopic guided mini-open transosseous repair with bursal augmentation in the treatment of MRCTs in a five-step approach.

View Article and Find Full Text PDF

Background: Understanding factors associated with improvements in subjective shoulder function after arthroscopic rotator cuff repair (ARCR) helps clinicians identify targets for postoperative rehabilitation. The aim of this study was to investigate the factors associated with subjective shoulder function after ARCR.

Methods: Patients who underwent ARCR for rotator cuff tear with at least 12 months of follow-up were included.

View Article and Find Full Text PDF

Background: The purpose of this study is to report outcomes of an arthroscopic knotless double-row (DR) rotator cuff repair (RCR) technique at 2- and 5- years postoperatively, and to compare clinical outcomes in patients undergoing knotless DR RCR with incorporated lateral row biceps tenodesis (LRT) vs. those without LRT.

Methods: All primary RCR surgeries were performed by a single surgeon at a single institution using a knotless transosseous equivalent (TOE) technique.

View Article and Find Full Text PDF

Background: Acromiohumeral interval (AHI) reversibility is used to evaluate whether superior humeral migration is fixed or flexible in patients with massive rotator cuff tears (MRCTs). AHI reversibility is measured as the difference in the AHI observed between standard and stress radiography. However, factors affecting AHI reversibility have not been studied in the existing literature.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!