Department of Urology, Fulya Acibadem Hospital, Sisli, Istanbul, Turkey.
Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey.
Int Urol Nephrol. 2024 Jan;56(1):17-21. doi: 10.1007/s11255-023-03773-0. Epub 2023 Sep 2.
ChatGPT is an artificial intelligence (AI) program with natural language processing. We analyzed ChatGPT's knowledge about urolithiasis whether it can be used to inform patients about urolithiasis.
Frequently asked questions (FAQs) about urolithiasis on the websites of urological associations and hospitals were analyzed. Also, strong recommendation-level information was gathered from the urolithiasis section of the European Association of Urology (EAU) 2022 Guidelines. All questions were asked in order in ChatGPT August 3rd version. All answers were evaluated separately by two specialist urologists and scored between 1 and 4, where 1: completely correct, 2: correct but inadequate, 3: a mix of correct and misleading information, and 4: completely incorrect.
Of the FAQs, 94.6% were answered completely correctly. No question was answered completely incorrectly. All questions about general, diagnosis, and ureteral stones were graded as 1. Of the 60 questions prepared according to the EAU guideline recommendations, 50 (83.3%) were evaluated as grade 1, and 8 (13.3%) and 2 (3.3%) as grade 3. All questions related to general, diagnostic, renal calculi, ureteral calculi, and metabolic evaluation received the same answer the second time they were asked.
Our findings demonstrated that ChatGPT accurately and satisfactorily answered more than 95% of the questions about urolithiasis. We conclude that applying ChatGPT in urology clinics under the supervision of urologists can help patients and their families to have better understanding on urolithiasis diagnosis and treatment.
ChatGPT 是一个具有自然语言处理功能的人工智能程序。我们分析了 ChatGPT 对尿石症的了解，以确定其是否可用于向患者提供尿石症相关信息。
分析了泌尿外科协会和医院网站上关于尿石症的常见问题 (FAQ)。此外，还从 2022 年欧洲泌尿外科学会 (EAU) 指南的尿石症部分收集了强烈推荐级别的信息。在 ChatGPT 8 月 3 日版本中，按照顺序提出了所有问题。两位泌尿外科专家分别对所有答案进行评估，并根据 1 到 4 分进行评分，其中 1 分表示完全正确，2 分表示正确但不充分，3 分表示正确与误导信息混合，4 分表示完全不正确。
FAQ 中 94.6%的问题回答完全正确。没有一个问题回答完全不正确。所有关于一般情况、诊断和输尿管结石的问题均评为 1 分。根据 EAU 指南推荐准备的 60 个问题中，有 50 个（83.3%）评为 1 分，8 个（13.3%）和 2 个（3.3%）评为 3 分。所有与一般情况、诊断、肾结石、输尿管结石和代谢评估相关的问题在第二次被问到的时候都给出了相同的答案。
我们的研究结果表明，ChatGPT 准确且满意地回答了超过 95%的关于尿石症的问题。我们得出结论，在泌尿科医生的监督下，在泌尿科诊所应用 ChatGPT 可以帮助患者及其家属更好地了解尿石症的诊断和治疗。
