Evaluating GPT-4o's Performance in the Official European Board of Radiology Exam: A Comprehensive Assessment.

Rationale And Objectives: This study aims to evaluate the performance of generative pre-trained transformer (GPT)-4o in the complete official European Board of Radiology (EBR) exam, designed to assess radiology knowledge, skills, and competence.

Materials And Methods: Questions based on text, image, or video and in the format of multiple choice, free-text reporting, or image annotation were uploaded into GPT-4o using standardized prompting. The results were compared to the average scores of radiologists taking the exam in real time.

Natural language processing for automatic evaluation of free-text answers - a feasibility study based on the European Diploma in Radiology examination.

Background: Written medical examinations consist of multiple-choice questions and/or free-text answers. The latter require manual evaluation and rating, which is time-consuming and potentially error-prone. We tested whether natural language processing (NLP) can be used to automatically analyze free-text answers to support the review process.