Purpose: The purpose of our study was to compare real-time, live observational scoring with delayed retrospective video review of operative performance and to determine whether the evaluation method affected the attainment of proficiency benchmarks.
Methods: Sixteen arthroscopy/sports medicine fellows and 2 senior residents completed training to perform arthroscopic Bankart repairs (ABRs) and arthroscopic rotator cuff repairs (ARCRs) using a proficiency-based progression curriculum. Each final operative performance for 15 randomly selected ABRs and 13 ARCRs performed on cadavers were scored live (observation during the operative performance) and on delayed video review (6-8 weeks) by 1 of 15 trained raters using validated metric-based (step and error) assessment tools. The inter-rater reliability (IRR) of live versus video review by a single rater was calculated, and changes to the trainee's attainment of the proficiency benchmarks were noted. The correlation coefficient (r) and the R were also calculated for the paired scores from the randomly selected performances.
Results: No significant differences in the observed IRR agreement or the attainment of the proficiency benchmarks were found when comparing live to video assessment for either ABR or ARCR. The correlation coefficients r and R were considerably lower than the agreement coefficient (IRR) for rotator cuff steps (e.g., R = 0.74 vs. IRR = 0.97, P = 0.001); Bankart errors (R = 0.73 vs. IRR = 0.98, P = 0.006); and rotator cuff errors (R = 0.48 vs. IRR = 0.98, P = 0.0002).
Conclusions: Real-time live and delayed video-based scoring of operative performance are essentially equivalent for the metric-based assessments of operative performance in ABRs and ARCRs. When the IRR agreement coefficient was compared with the correlation coefficients, the former was found to have greater homogeneity and measurement precision.
Clinical Relevance: Metric-based live scoring is reliable and accurate for operative performance assessment, including high-stakes evaluations.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.arthro.2021.04.060 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
The development and evaluation of nine obesity-based indices for gallstones in U.S. adults.
Int J Surg
January 2025
Department of General Surgery.
Objective: Gallstones have gradually become a highly prevalent digestive disease worldwide. This study aimed to investigate the association of nine different obesity-related indicators (BRI, RFM, BMI, WC, LAP, CMI, VAI, AIP, TyG) with gallstones and to compare their predictive properties for screening gallstones.
Methods: Data for this study were obtained from the National Health and Nutrition Examination Survey (NHANES) for the 2017-2020 cycle, and weighted logistic regression analyses with multi-model adjustment were conducted to explore the association of the nine indicators with gallstones.
Deep learning for kidney trauma detection: CT image algorithm performance and external validation: experimental study.
Int J Surg
January 2025
Department of Trauma and Emergency Surgery, Chang Gung Memorial Hospital, Linkou; Chang Gung University, Taoyuan, Taiwan.
Background: Detecting kidney trauma on CT scans can be challenging and is sometimes overlooked. While deep learning (DL) has shown promise in medical imaging, its application to kidney injuries remains underexplored. This study aims to develop and validate a DL algorithm for detecting kidney trauma, using institutional trauma data and the Radiological Society of North America (RSNA) dataset for external validation.
View Article and Find Full Text PDFMultimodal large language models address clinical queries in laryngeal cancer surgery: a comparative evaluation of image interpretation across different models.
Int J Surg
January 2025
Department of Otolaryngology Head and Neck Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, Anhui Province, China.
Background And Objectives: Recent advances in multimodal large language models (MLLMs) have shown promise in medical image interpretation, yet their utility in surgical contexts remains unexplored. This study evaluates six MLLMs' performance in interpreting diverse imaging modalities for laryngeal cancer surgery.
Methods: We analyzed 169 images (X-rays, CT scans, laryngoscopy, and pathology findings) from 50 patients using six state-of-the-art MLLMs.
Exploring the landscape of exosomes in heart failure: a bibliometric analysis.
Int J Surg
January 2025
Department of Colorectal Surgery, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China.
Background: Exosomes, which carry bioactive RNAs, proteins, lipids, and metabolites, have emerged as novel diagnostic markers and therapeutic agents for heart failure (HF). This study aims to elucidate the trends, key contributors, and research hotspots of exosomes in HF.
Methods: We collected publications related to exosomes in HF from the Web of Science Core Collection.
Assessment of simulation training efficacy in improving microsurgical skills: a retrospective analysis.
Int J Surg
January 2025
Department of Orthopaedics, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Background: Microsurgery demands an intensive period of skill acquisition due to its inherent complexity. The development and implementation of innovative training methods are essential for enhancing microsurgical outcomes. This study aimed to evaluate the impact of a simulation training program on the clinical results of fingertip replantation surgeries.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!