Performance of generative pre-trained transformers (GPTs) in Certification Examination of the College of Family Physicians of Canada.

Introduction: The application of large language models such as generative pre-trained transformers (GPTs) has been promising in medical education, and its performance has been tested for different medical exams. This study aims to assess the performance of GPTs in responding to a set of sample questions of short-answer management problems (SAMPs) from the certification exam of the College of Family Physicians of Canada (CFPC).

Method: Between August 8th and 25th, 2023, we used GPT-3.