Objective: To evaluate the efficiency of the four domestic language models, ERNIE Bot, ChatGLM2, Spark Desk and Qwen-14B-Chat, all with a massive user base and significant social attention, in response to consultations about PCa-related perioperative nursing and health education.
Methods: We designed a questionnaire that includes 15 questions commonly concerned by patients undergoing radical prostatectomy and 2 common nursing cases, and inputted the questions into each of the four language models for simulation consultation. Three nursing experts assessed the model responses based on a pre-designed Likert 5-point scale in terms of accuracy, comprehensiveness, understandability, humanistic care, and case analysis.