Screening/diagnosis of pediatric endocrine disorders through the artificial intelligence model in different language settings.

Eur J Pediatr

Department of Endocrinology and Metabolism, Shanghai Children's Medical Center, School of Medicine, Shanghai Jiao Tong University, Shanghai, 200127, China.

Published: June 2024

Unlabelled: This study is aimed at examining the impact of ChatGPT on pediatric endocrine and metabolic conditions, particularly in the areas of screening and diagnosis, in both Chinese and English modes. A 40-question questionnaire covering the four most common pediatric endocrine and metabolic conditions was posed to ChatGPT in both Chinese and English three times each. Six pediatric endocrinologists evaluated the responses. ChatGPT performed better when responding to questions in English, with an unreliable rate of 7.5% compared to 27.5% for Chinese questions, indicating a more consistent response pattern in English. Among the reliable questions, the answers were more comprehensive and satisfactory in the English mode. We also found disparities in ChatGPT's performance when interacting with different target groups and diseases, with improved performance for questions posed by clinicians in English and better performance for questions related to diabetes and overweight/obesity in Chinese for both clinicians and patients. Language comprehension, providing incomprehensive answers, and errors in key data were the main contributors to the low scores, according to reviewer feedback.

Conclusion: Despite these limitations, as ChatGPT continues to evolve and expand its network, it has significant potential as a practical and effective tool for clinical diagnosis and treatment.

What Is Known: • The deep learning-based large-language model ChatGPT holds great promise for improving clinical practice for both physicians and patients and has the potential to increase the speed and accuracy of disease screening and diagnosis, as well as enhance the overall efficiency of the medical process. However, the reliability and appropriateness of AI model responses in specific field remains unclear. • This study focused on the reliability and appropriateness of AI model responses to straightforward and fundamental questions related to the four most prevalent pediatric endocrine and metabolic disorders, for both healthcare providers and patients, in different language scenarios.

What Is New: • The AI model performed better when responding to questions in English, with more consistent, as well as more comprehensive and satisfactory responses. In addition, we also found disparities in ChatGPT's performance when interacting with different target groups and different diseases. • Despite these limitations, as ChatGPT continues to evolve and expand its network, it has significant potential as a practical and effective tool for clinical diagnosis and treatment.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11098926PMC
http://dx.doi.org/10.1007/s00431-024-05527-1DOI Listing

Publication Analysis

Top Keywords

pediatric endocrine
16
endocrine metabolic
12
metabolic conditions
8
screening diagnosis
8
chinese english
8
performed better
8
better responding
8
responding questions
8
questions english
8
comprehensive satisfactory
8

Similar Publications

Perioperative Chemotherapy or Preoperative Chemoradiotherapy in Esophageal Cancer.

N Engl J Med

January 2025

From Bielefeld University, Medical School and University Medical Center Ostwestfalen-Lippe, Campus Hospital Lippe, Detmold, Germany (J.H.); the Department of Radiation Oncology, Medical University of Graz, Graz, Austria (T.B.); the Clinical Trials Unit, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany (C.S.); the Institute of Surgical Pathology, University Medical Center Freiburg, Germany (P.B.); the Department of Surgery, University Medical Center Schleswig-Holstein-Campus Lübeck, Lübeck, Germany (B.K., T.K.); Comprehensive Cancer Center Augsburg, Faculty of Medicine, University of Augsburg, Augsburg, Germany (R.C.); the Department of General and Visceral Surgery, University Medical Center Freiburg, Freiburg, Germany (S.U.); the Department of General, Visceral, and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany (J.R.I.); the Department of Gastrointestinal Surgery, IRCCS San Raffaele Scientific Institute and San Raffaele Vita-Salute University, Milan (I.G.); the Department of General, Visceral, Thoracic, and Endocrine Surgery, Johannes Wesling University Hospital Minden, Ruhr University Bochum, Minden, Germany (B.G.); the Department of General, Visceral, and Pediatric Surgery, University Medical Center Göttingen, Göttingen, Germany (M.G.); the Department of General, Visceral, Thoracic, Transplantation, and Pediatric Surgery, University Medical Center Schleswig-Holstein-Campus Kiel, Kiel, Germany (B.R.); the Department of General, Visceral, Transplantation, Vascular, and Pediatric Surgery, University Hospital, University of Würzburg, Würzburg, Germany (J.F.L.); the Department of General, Visceral, Cancer, and Transplantation Surgery, University Hospital of Cologne, Cologne, Germany (C.B.); the Department of Hematology and Oncology, Sana Klinikum Offenbach, Offenbach am Main, Germany (E.R.); the Department of Surgery, Klinikum Dortmund, Klinikum der Universität Witten-Herdecke, Dortmund, Germany (M.S.); the Department of Surgery, University Hospital Magdeburg, Magdeburg, Germany (F.B.); the Department of Medicine I, University Hospital Carl Gustav Carus, Technical University Dresden, Dresden, Germany (G.F.); the Department of Hematology, Oncology, and Cancer Immunology, Charité-University Medicine Berlin, Campus Virchow-Klinikum, Berlin (P.T.-P.); the Department of General, Visceral, Cancer, and Transplantation Surgery, University Hospital Essen, Essen, Germany (U.P.N.); the Department of General, Visceral, and Transplantation Surgery, University Hospital Muenster, Muenster, Germany (A.P.); the Department of Radiotherapy and Oncology, Goethe University Frankfurt, University Hospital, Frankfurt, Germany (D.I.); the Division of Gastroenterology, Rheumatology, and Infectology, Department of Medicine, Charité-Universitätsmedizin Berlin, Berlin (S.D.); the Department of Surgery, Robert Bosch Hospital, Stuttgart, Germany (T.S.); the Department of Surgery, University Medical Center Erlangen, Friedrich Alexander University Erlangen-Nürnberg, Erlangen, Germany (C.K.); the Department of Medicine II, Saarland University Medical Center, Saarland University, Homburg, Germany (S.Z.); the Department of General, Visceral, and Transplant Surgery, Ludwig Maximilian University Hospital, Munich, Germany (J.W.); the Department of Internal Medicine I, Klinikum Mutterhaus der Borromaerinnen, Trier, Germany (R.M.); the Departments of Hematology, Oncology, and Palliative Care, Klinikum Stuttgart, Stuttgart, Germany (G.I.); the Department of General, Visceral, and Transplant Surgery, University Medical Center Mainz, Mainz, Germany (P.G.); and the Department of Medicine II, University Cancer Center Leipzig, Cancer Center Central Germany, University Medical Center Leipzig, Leipzig, Germany (F.L.).

Background: The best multimodal approach for resectable locally advanced esophageal adenocarcinoma is unclear. An important question is whether perioperative chemotherapy is preferable to preoperative chemoradiotherapy.

Methods: In this phase 3, multicenter, randomized trial, we assigned in a 1:1 ratio patients with resectable esophageal adenocarcinoma to receive perioperative chemotherapy with FLOT (fluorouracil, leucovorin, oxaliplatin, and docetaxel) plus surgery or preoperative chemoradiotherapy (radiotherapy at a dose of 41.

View Article and Find Full Text PDF

Identification of factors related to functional prognoses in craniopharyngiomas.

J Neurooncol

January 2025

Department of Neurological Surgery, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, 2-5-1 Shikata-cho, Kita-ku, Okayama, 700-8558, Japan.

Purpose: Craniopharyngiomas are histologically benign tumors, but their proximity to vital neurovascular structures can significantly deteriorate functional prognoses and severely restrict patients' social interaction and activity. We retrospectively identified risk factors related to the functional prognoses in patients with craniopharyngioma treated at our center.

Methods: A retrospective analysis was conducted on 40 patients who underwent surgery for craniopharyngioma and follow-up at our institution between 2003 and 2022.

View Article and Find Full Text PDF

Background: Multiple endocrine neoplasia type 2 syndrome (MEN2) is a hereditary disease resulting from mutations of the rearranged during transfection (RET) protooncogene subclassified into MEN2A [medullary thyroid carcinoma (MTC), pheochromocytoma, and primary hyperparathyroidism] and MEN2B (MTC, pheochromocytoma, Marfanoid habitus, mucous neuromas, and intestinal ganglioneuromatosis). Prophylactic thyroidectomy is recommended in RET-mutated patients. The age at which it should be performed depends on the type and aggressiveness of the mutation.

View Article and Find Full Text PDF

Introduction: Premature ovarian insufficiency (POI) is a condition characterized by ovarian dysfunction occurring before the age of 40, and its etiology is multifactorial, including genetic, immunological, infectious, environmental, and iatrogenic factors, with over half of the cases remaining unexplained. Whether the microbial communities and metabolites in follicular fluid, which is the direct microenvironment for oocyte survival, are related to POI has not been reported.

Methods: In this study, Follicular fluid samples of 26 patients with POI and 27 controls with a normal ovarian reserve were collected and analyzed using 16S rDNA sequencing and untargeted metabolomics.

View Article and Find Full Text PDF

Background: Pediatric growth hormone deficiency (GHD) is a disease resulting from the impaired growth hormone-insulin-like growth factor-1 (GH-IGF-1) axis, but the effects of GHD on children's behavior and brain microstructural structure alterations have not yet been fully clarified. We aimed to investigate the quantitative profiles of gray matter and white matter in pediatric GHD using synthetic magnetic resonance imaging (MRI).

Methods: The data of 50 children with GHD and 50 typically developing (TD) children were prospectively collected.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!