Michalska Adriana A, Stefaniak Małgorzata M, Gotlib-Małkowska Joanna
Department of Education and Research in Health Sciences, Medical University of Warsaw, Warsaw, Poland.
Department of Obstetrics and Gynecology Didactics, Medical University of Warsaw, Warsaw, Poland.
Med Sci Monit. 2025 Jul 3;31:e947992. doi: 10.12659/MSM.947992.
BACKGROUND Cervical cancer (CC) mortality remains a global health problem, and women's awareness of the need for regular CC screening is insufficient. In the era of rapid development of artificial intelligence (AI), large language models (LLMs) such as ChatGPT may become an important source of information about health, including women's health and screening. The aim of the study was to assess the quality of ChatGPT-generated medical information on cervical cancer screening (MICC_GPT). MATERIAL AND METHODS A total of 196 MICC_GPT items were assessed. Objective readability was assessed on a scale of 1 to 7 using Jasnopis.pl programming. Subjective assessment of the MICC-GPT on a scale of 1 to 5 was made by 4 independent expert reviewers. RESULTS The average difficulty level of the MICC_GPT was 5.314, and full understanding of the MICC_GPT requires the target audience to have completed at least 15 years of formal education. In the opinion of the expert reviewers, most of the MICC_GPTs (71%) met the criteria of relevance, accuracy, completeness, clarity, coherence, and appropriateness. CONCLUSIONS ChatGPT-generated information in Polish on the topic of cervical cancer screening is accurate, detailed, comprehensive, clear, coherent and appropriate for the target audience, confirming the great potential of ChatGPT in health education, as well as promotion of screening tests and cervical cancer prophylaxis. To reduce the level of difficulty and increase the accessibility of the MICC_GPT for less educated end-users, the MICC_GPT needs to be simplified, especially in terms of specialized medical terminology.
背景 宫颈癌（CC）死亡率仍然是一个全球性的健康问题，而且女性对定期进行宫颈癌筛查必要性的认识不足。在人工智能（AI）快速发展的时代，ChatGPT等大语言模型（LLMs）可能会成为包括女性健康和筛查在内的健康信息的重要来源。本研究的目的是评估ChatGPT生成的关于宫颈癌筛查的医学信息（MICC_GPT）的质量。
材料与方法 共评估了196条MICC_GPT条目。使用Jasnopis.pl编程以1至7的等级对客观可读性进行评估。由4名独立的专家评审员以1至5的等级对MICC - GPT进行主观评估。
结果 MICC_GPT的平均难度等级为5.314，要完全理解MICC_GPT，目标受众至少需要完成15年的正规教育。在专家评审员看来，大多数MICC_GPT（71%）符合相关性、准确性、完整性、清晰度、连贯性和适当性的标准。
结论 ChatGPT生成的波兰语关于宫颈癌筛查主题的信息准确、详细、全面、清晰、连贯且适合目标受众，证实了ChatGPT在健康教育以及促进筛查测试和宫颈癌预防方面的巨大潜力。为降低难度并提高MICC_GPT对受教育程度较低的最终用户的可及性，需要简化MICC_GPT，尤其是在专业医学术语方面。
