Yurtcu Engin, Ozvural Seyfettin, Keyif Betul
Department of Obstetrics and Gynecology, Faculty of Medicine, Duzce University, Duzce, Türkiye.
Department of Obstetrics and Gynecology, Acıbadem Hospital, Biruni University, Istanbul, Türkiye.
Int J Gynaecol Obstet. 2025 Feb;168(2):502-507. doi: 10.1002/ijgo.15861. Epub 2024 Aug 16.
To analyze the knowledge of ChatGPT about cervical cancer (CC).
Official websites of professional health institutes, and websites created by patients and charities underwent strict screening. Using CC-related keywords, common inquiries by the public and comments about CC were searched in social media applications with these data, a list of frequently asked questions (FAQs) was prepared. When preparing question about CC, the European Society of Gynecological Oncology (ESGO), European Society for Radiotherapy and Oncology (ESTRO), and European Society of Pathology (ESP) guidelines were used. The answers given by ChatGPT were scored according to the Global Quality Score (GQS).
When all ChatGPT answers to FAQs about CC were evaluated with regard to GQS, 68 ChatGPT answers were classified as score 5, and none of ChatGPT answers for FAQs were scored as 2 or 1. Moreover, ChatGPT answered 33 of 53 (62.3%) CC-related questions based on ESGO, ESTRO, and ESP guidelines with completely accurate and satisfactory responses (GQS 5). In addition, eight answers (15.1%), seven answers (13.2%), four answers (7.5%), and one answer (1.9%) were categorized as GQS 4, GQS 3, GQS 2, and GQS 1, respectively. The reproducibility rate of ChatGPT answers about CC-related FAQs and responses about those guideline-based questions was 93.2% and 88.7%, respectively.
ChatGPT had an accurate and satisfactory response rate for FAQs about CC with regards to GQS. However, the accuracy and quality of ChatGPT answers significantly decreased for questions based on guidelines.
分析ChatGPT关于宫颈癌（CC）的知识。
对专业健康机构的官方网站以及患者和慈善机构创建的网站进行严格筛选。使用与CC相关的关键词，在社交媒体应用程序中搜索公众的常见问题和关于CC的评论，并利用这些数据编制了常见问题解答（FAQ）列表。在准备关于CC的问题时，采用了欧洲妇科肿瘤学会（ESGO）、欧洲放射治疗与肿瘤学会（ESTRO）和欧洲病理学会（ESP）的指南。根据全球质量评分（GQS）对ChatGPT给出的答案进行评分。
当根据GQS对ChatGPT关于CC的所有FAQ答案进行评估时，68个ChatGPT答案被归类为5分，且关于FAQ的ChatGPT答案中没有一个被评为2分或1分。此外，ChatGPT基于ESGO、ESTRO和ESP指南对53个（62.3%）与CC相关的问题给出了完全准确且令人满意的回答（GQS为5）。此外，分别有8个答案（15.1%）、7个答案（13.2%）、4个答案（7.5%）和1个答案（1.9%）被归类为GQS 4、GQS 3、GQS 2和GQS 1。ChatGPT关于CC相关FAQ答案和基于这些指南问题的回答的重现率分别为93.2%和88.7%。
就GQS而言，ChatGPT对关于CC的FAQ有准确且令人满意的回答率。然而，对于基于指南的问题，ChatGPT答案的准确性和质量显著下降。
