Assessing the Linking Between the Orthopaedic In-Training Examination and the American Board of Orthopaedic Surgery Part I Certification Examination.

J Am Acad Orthop Surg

From the Department of Orthopaedic Surgery, Brown University, Providence, Rhode Island (Fritz), the Department of Orthopaedic Surgery and Rehabilitation, Loyola University Chicago Medical Center, Maywood, IL (Bednar), the Data Harbor Solutions, Chicago, IL (Harrast), the Department of Orthopaedic Surgery and Rehabilitation, Wake Forest University School of Medicine, Winston-Salem, NC (Martin), the American Board of Orthopedic Surgery, Chapel Hill, NC (Saniei), the Department of Orthopedic Surgery, Boston University, Boston, MA (Tornetta), the American Academy of Orthopaedic Surgeons, Rosemount, IL (Troise), and the Department of Orthopaedic Surgery, University of Minnesota, Minneapolis, MN (Van Heest).

Published: March 2025

Introduction: Since 2020, the American Academy of Orthopaedic Surgeons (AAOS) and American Board of Orthopaedic Surgery (ABOS) have collaborated to link the AAOS Orthopaedic In-Training Examination (OITE) and the ABOS part I Certification Examination, allowing the identification of a minimum score on each annual OITE that corresponds to a minimum passing part I score. The purpose of this study is to assess the performance of this examination linking over these past 3 years.

Methods: From 2020 to 2022, the AAOS provided each graduating resident's OITE score; from 2021 to 2023, the ABOS provided each examinee's ABOS part I pass-fail result. Examination scores were matched at the individual level and deidentified for data analysis.

Results: A total of 2,247 subjects took both the OITE and the ABOS during the same cycle, during the 3-year study period. The ABOS part I pass rates in 2021, 2022, and 2023 were 92.9%, 98.1%, and 98.4%, respectively, for those taking the OITE the prior year. The positive predictive value of achieving the minimum passing score on the OITE for passing part I increased from 95.1% in 2021 to 99.8% and 99.7% in 2022 and 2023, respectively. The negative predictive value of not achieving the minimum passing score on the OITE for failing part I decreased from 24.7% in 2021 to 5.3% in 2022 and 10.1% in 2023.

Discussion: This study is the first of its kind and demonstrates the initial results of the examination linking between the OITE and the ABOS part I Examination. This information can be helpful for residents and residency program directors. Moreover, the examination linking provides a step toward obtaining a standardized assessment of knowledge throughout all 5 years of residency.

Download full-text PDF

Source
http://dx.doi.org/10.5435/JAAOS-D-24-00544DOI Listing

Publication Analysis

Top Keywords

oite abos
12
minimum passing
12
passing score
12
examination linking
12
examination
9
orthopaedic in-training
8
in-training examination
8
american board
8
board orthopaedic
8
orthopaedic surgery
8

Similar Publications

Assessing the Linking Between the Orthopaedic In-Training Examination and the American Board of Orthopaedic Surgery Part I Certification Examination.

J Am Acad Orthop Surg

March 2025

From the Department of Orthopaedic Surgery, Brown University, Providence, Rhode Island (Fritz), the Department of Orthopaedic Surgery and Rehabilitation, Loyola University Chicago Medical Center, Maywood, IL (Bednar), the Data Harbor Solutions, Chicago, IL (Harrast), the Department of Orthopaedic Surgery and Rehabilitation, Wake Forest University School of Medicine, Winston-Salem, NC (Martin), the American Board of Orthopedic Surgery, Chapel Hill, NC (Saniei), the Department of Orthopedic Surgery, Boston University, Boston, MA (Tornetta), the American Academy of Orthopaedic Surgeons, Rosemount, IL (Troise), and the Department of Orthopaedic Surgery, University of Minnesota, Minneapolis, MN (Van Heest).

Introduction: Since 2020, the American Academy of Orthopaedic Surgeons (AAOS) and American Board of Orthopaedic Surgery (ABOS) have collaborated to link the AAOS Orthopaedic In-Training Examination (OITE) and the ABOS part I Certification Examination, allowing the identification of a minimum score on each annual OITE that corresponds to a minimum passing part I score. The purpose of this study is to assess the performance of this examination linking over these past 3 years.

Methods: From 2020 to 2022, the AAOS provided each graduating resident's OITE score; from 2021 to 2023, the ABOS provided each examinee's ABOS part I pass-fail result.

View Article and Find Full Text PDF

Background: Chat Generative Pre-Trained Transformer (ChatGPT) is an artificial intelligence (AI) chatbot capable of delivering human-like responses to a seemingly infinite number of inquiries. For the technology to perform certain healthcare-related tasks or act as a study aid, the technology should have up-to-date knowledge and the ability to reason through medical information. The purpose of this study was to assess the orthopedic knowledge and reasoning ability of ChatGPT by querying it with orthopedic board-style questions.

View Article and Find Full Text PDF

Introduction: Publicly available AI language models such as ChatGPT have demonstrated utility in text generation and even problem-solving when provided with clear instructions. Amidst this transformative shift, the aim of this study is to assess ChatGPT's performance on the orthopaedic surgery in-training examination (OITE).

Methods: All 213 OITE 2021 web-based questions were retrieved from the AAOS-ResStudy website (https://www.

View Article and Find Full Text PDF

Introduction Artificial intelligence (AI) models using large language models (LLMs) and non-specific domains have gained attention for their innovative information processing. As AI advances, it's essential to regularly evaluate these tools' competency to maintain high standards, prevent errors or biases, and avoid flawed reasoning or misinformation that could harm patients or spread inaccuracies. Our study aimed to determine the performance of Chat Generative Pre-trained Transformer (ChatGPT) by OpenAI and Google BARD (BARD) in orthopedic surgery, assess performance based on question types, contrast performance between different AIs and compare AI performance to orthopedic residents.

View Article and Find Full Text PDF

Background: Resident training programs in the US use the Orthopaedic In-Training Examination (OITE) developed by the American Academy of Orthopaedic Surgeons (AAOS) to assess the current knowledge of their residents and to identify the residents at risk of failing the Amerian Board of Orthopaedic Surgery (ABOS) examination. Optimal strategies for OITE preparation are constantly being explored. There may be a role for Large Language Models (LLMs) in orthopaedic resident education.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!