Department of Gastroenterology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou Medical University, Guangzhou, P. R. China.
Institute of Therapeutic Innovations and Outcomes, College of Pharmacy, The Ohio State University, Columbus, OH, USA.
Ann Biomed Eng. 2024 Dec;52(12):3141-3144. doi: 10.1007/s10439-024-03600-2. Epub 2024 Aug 12.
ChatGPT could be a useful tool in the infectious disease field. However, the application of ChatGPT for the treatment of infectious diseases in vulnerable population has not been determined.
We designed questions about antibiotic use, including the choice of antibiotics, dose, and treatment duration for prevalent infectious disease in vulnerable populations. Each query was posed to ChatGPT-4, and the answers were independently evaluated by two authors. When there were significant differences in the final scores between the two authors, they discussed the case and answers to obtain results.
Our analysis revealed that 38.1% of responses were comprehensive and correct, with 11.9% containing errors for medication use for patients during pregnancy. For the antibiotic allergy-related questions, 36.1% of responses were comprehensive and correct, and 18.1% contained errors. For older adults, 27.5% of responses were comprehensive and correct, while 25% contained errors. The error rate in patients with kidney disease was 79.2%. For children, 43.8% of answers contained errors.
ChatGPT produced high rates of inaccurate information for treating infectious diseases in special population. Thus, recommendations generated by ChatGPT should be used with caution and checked by healthcare professionals to ensure accuracy and comprehensiveness prior to use.
ChatGPT 在传染病领域可能是一种有用的工具。然而,ChatGPT 在治疗弱势群体中的传染病方面的应用尚未确定。
我们设计了关于抗生素使用的问题,包括弱势群体中常见传染病的抗生素选择、剂量和治疗持续时间。每个查询都提交给 ChatGPT-4,由两位作者独立评估答案。当两位作者的最终评分存在显著差异时,他们会讨论病例和答案以得出结果。
我们的分析显示,对于孕妇用药的问题,38.1%的回答全面且正确,11.9%的回答存在错误;对于与抗生素过敏相关的问题,36.1%的回答全面且正确,18.1%的回答存在错误;对于老年人,27.5%的回答全面且正确,25%的回答存在错误;对于肾病患者,错误率为 79.2%;对于儿童,43.8%的回答存在错误。
ChatGPT 对治疗特殊人群的传染病产生了高比例的不准确信息。因此,ChatGPT 生成的建议应谨慎使用,并在使用前由医疗保健专业人员进行检查,以确保准确性和全面性。