Comparison of the Performance of Artificial Intelligence Versus Medical Professionals in the Polish Final Medical Examination.

Background: The rapid development of artificial intelligence (AI) technologies like OpenAI's Generative Pretrained Transformer (GPT), particularly ChatGPT, has shown promising applications in various fields, including medicine. This study evaluates ChatGPT's performance on the Polish Final Medical Examination (LEK), comparing its efficacy to that of human test-takers.

Methods: The study analyzed ChatGPT's ability to answer 196 multiple-choice questions from the spring 2021 LEK.