Background: Chat Generative Pre-trained Transformer (ChatGPT), OpenAI Limited Partnership, San Francisco, CA, USA is an artificial intelligence language model gaining popularity because of its large database and ability to interpret and respond to various queries. Although it has been tested by researchers in different fields, its performance varies depending on the domain. We aimed to further test its ability in the medical field.
Methods: We used questions from Taiwan's 2022 Family Medicine Board Exam, which combined both Chinese and English and covered various question types, including reverse questions and multiple-choice questions, and mainly focused on general medical knowledge. We pasted each question into ChatGPT and recorded its response, comparing it to the correct answer provided by the exam board. We used SAS 9.4 (Cary, North Carolina, USA) and Excel to calculate the accuracy rates for each question type.
Results: ChatGPT answered 52 questions out of 125 correctly, with an accuracy rate of 41.6%. The questions' length did not affect the accuracy rates. These were 45.5%, 33.3%, 58.3%, 50.0%, and 43.5% for negative-phrase questions, multiple-choice questions, mutually exclusive options, case scenario questions, and Taiwan's local policy-related questions, with no statistical difference observed.
Conclusion: ChatGPT's accuracy rate was not good enough for Taiwan's Family Medicine Board Exam. Possible reasons include the difficulty level of the specialist exam and the relatively weak database of traditional Chinese language resources. However, ChatGPT performed acceptably in negative-phrase questions, mutually exclusive questions, and case scenario questions, and it can be a helpful tool for learning and exam preparation. Future research can explore ways to improve ChatGPT's accuracy rate for specialized exams and other domains.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1097/JCMA.0000000000000946 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Ergosterol alleviates hepatic steatosis and insulin resistance via promoting fatty acid β-oxidation by activating mitochondrial ACSL1.
Cell Rep
January 2025
State Key Laboratory of Natural Medicines, School of Traditional Chinese Pharmacy, China Pharmaceutical University, Nanjing, Jiangsu, China. Electronic address:
Sterols target sterol-sensing domain (SSD) proteins to lower cholesterol and circulating and hepatic triglyceride levels, but the mechanism remains unclear. In this study, we identify acyl-coenzyme A (CoA) synthetase long-chain family member 1 (ACSL1) as a direct target of ergosterol (ES). The C-terminal domain of ACSL1 undergoes conformational changes from closed to open, and ES may target the drug-binding pocket in the acetyl-CoA synthetase-like domain 1 (ASLD1) of ACSL1 to stabilize the closed conformation and maintain its activity.
View Article and Find Full Text PDFCMPK2 promotes NLRP3 inflammasome activation via mtDNA-STING pathway in house dust mite-induced allergic rhinitis.
Clin Transl Med
January 2025
Allergy Center, Department of Otolaryngology, Affiliated Eye and ENT Hospital, Fudan University, Shanghai, China.
Background: House dust mite (HDM) is the leading allergen for allergic rhinitis (AR). Although allergic sensitisation by inhaled allergens renders susceptible individuals prone to developing AR, the molecular mechanisms driving this process remain incompletely elucidated.
Objective: This study aimed to elucidate the molecular mechanisms underlying HDM-induced AR.
[Advances in the study of viruses inhibiting the production of advanced autophagy or interferon through Rubicon to achieve innate immune escape].
Xi Bao Yu Fen Zi Mian Yi Xue Za Zhi
January 2025
Department of Pathogen Biology and Immunology, Kunming Medical University, Kunming 650500, China. *Corresponding authors, E-mail:
The innate immune response is the first line of defense for the host against viral infections. Targeted degradation of pathogenic microorganisms through autophagy, in conjunction with pattern recognition receptors synergistically inducing the production of interferon (IFN), constitutes an important pathway for the body to resist viral infections. Rubicon, a Run domain Beclin 1-interacting and cysteine-rich domain protein, has an inhibitory effect on autophagy and IFN production.
View Article and Find Full Text PDFProgress in the Study of TAp73 and Sperm Apoptosis.
Cell Biochem Funct
January 2025
Department of Physiology and Pharmacology, Anhui University of Chinese Medicine, Hefei, Anhui, China.
The study of the mechanism of oligoasthenospermia, which is a major cause of male infertility, has been the focus of research in the field of male reproduction. TAp73, a member of the p53 family of oncogenes, is endowed with tumor-suppressing activity due to its structural and functional homology with p53. It has been found that TAp73, plays a key role in spermatogenesis and maintaining male reproduction.
View Article and Find Full Text PDFCowden Syndrome and Oral Lesions: A Case Report Using MLPA.
Am J Case Rep
January 2025
Research Institute of Dentistry, Department of Integral Dental Clinics, University Center of Health Sciences, Universidad de Guadalajara, Guadalajara, Mexico.
BACKGROUND Cowden syndrome is a genetic disorder that predisposes individuals to cancer and is characterized by hamartomas derived from 3 germ layers. Although the clinical signs can be pathognomonic, diagnosis is often aided by biopsies, histopathological examination of oral and cutaneous lesions, and genetic studies, including multiple ligation-dependent probe amplification (MLPA). CASE REPORT We report a case of a 35-year-old woman who manifested with multiple lesions in the buccal mucosa, dorsum of the tongue, and gums, along with papillomatous papules on her facial skin and the dorsal surfaces of her hands.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!