Accuracy and Reliability of Chatbot Responses to Physician Questions.

Importance: Natural language processing tools, such as ChatGPT (generative pretrained transformer, hereafter referred to as chatbot), have the potential to radically enhance the accessibility of medical information for health professionals and patients. Assessing the safety and efficacy of these tools in answering physician-generated questions is critical to determining their suitability in clinical settings, facilitating complex decision-making, and optimizing health care efficiency.

Objective: To assess the accuracy and comprehensiveness of chatbot-generated responses to physician-developed medical queries, highlighting the reliability and limitations of artificial intelligence-generated medical information.

Extended Follow-Up of Chronic Immune-Related Adverse Events Following Adjuvant Anti-PD-1 Therapy for High-Risk Resected Melanoma.

Importance: Anti-programmable cell death-1 (anti-PD-1) improves relapse-free survival when used as adjuvant therapy for high-risk resected melanoma. However, it can lead to immune-related adverse events (irAEs), which become chronic in approximately 40% of patients with high-risk melanoma treated with adjuvant anti-PD-1.

Objective: To determine the incidence, characteristics, and long-term outcomes of chronic irAEs from adjuvant anti-PD-1 therapy.

Assessing the Accuracy and Reliability of AI-Generated Medical Responses: An Evaluation of the Chat-GPT Model.

Background: Natural language processing models such as ChatGPT can generate text-based content and are poised to become a major information source in medicine and beyond. The accuracy and completeness of ChatGPT for medical queries is not known.

Methods: Thirty-three physicians across 17 specialties generated 284 medical questions that they subjectively classified as easy, medium, or hard with either binary (yes/no) or descriptive answers.