Garcia Valencia Oscar A, Thongprayoon Charat, Miao Jing, Suppadungsuk Supawadee, Krisanapan Pajaree, Craici Iasmina M, Jadlowiec Caroline C, Mao Shennen A, Mao Michael A, Leeaphorn Napat, Budhiraja Pooja, Cheungpasitporn Wisit
Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, United States.
Chakri Naruebodindra Medical Institute, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Samut Prakan, Thailand.
Front Digit Health. 2024 Apr 10;6:1366967. doi: 10.3389/fdgth.2024.1366967. eCollection 2024.
Addressing disparities in living kidney donation requires making information accessible across literacy levels, especially important given that the average American adult reads at an 8th-grade level. This study evaluated the effectiveness of ChatGPT, an advanced AI language model, in simplifying living kidney donation information to an 8th-grade reading level or below.
We used ChatGPT versions 3.5 and 4.0 to modify 27 questions and answers from Donate Life America, a key resource on living kidney donation. We measured the readability of both original and modified texts using the Flesch-Kincaid formula. A paired -test was conducted to assess changes in readability levels, and a statistical comparison between the two ChatGPT versions was performed.
Originally, the FAQs had an average reading level of 9.6 ± 1.9. Post-modification, ChatGPT 3.5 achieved an average readability level of 7.72 ± 1.85, while ChatGPT 4.0 reached 4.30 ± 1.71, both with a -value <0.001 indicating significant reduction. ChatGPT 3.5 made 59.26% of answers readable below 8th-grade level, whereas ChatGPT 4.0 did so for 96.30% of the texts. The grade level range for modified answers was 3.4-11.3 for ChatGPT 3.5 and 1-8.1 for ChatGPT 4.0.
Both ChatGPT 3.5 and 4.0 effectively lowered the readability grade levels of complex medical information, with ChatGPT 4.0 being more effective. This suggests ChatGPT's potential role in promoting diversity and equity in living kidney donation, indicating scope for further refinement in making medical information more accessible.
解决活体肾捐赠中的差异问题需要使信息在不同文化程度人群中都易于获取,鉴于美国成年人均阅读水平为八年级,这一点尤为重要。本研究评估了先进的人工智能语言模型ChatGPT在将活体肾捐赠信息简化至八年级及以下阅读水平方面的有效性。
我们使用ChatGPT 3.5版和4.0版修改了来自“美国捐赠生命”组织(活体肾捐赠的关键信息来源)的27个问答。我们使用弗莱施-金凯德公式测量原始文本和修改后文本的可读性。进行配对t检验以评估可读性水平的变化,并对两个ChatGPT版本进行统计比较。
最初,常见问题解答的平均阅读水平为9.6±1.9。修改后,ChatGPT 3.5的平均可读性水平达到7.72±1.85,而ChatGPT 4.0达到4.30±1.71,两者的p值均<0.001,表明有显著降低。ChatGPT 3.5使59.26%的答案在八年级以下水平可读,而ChatGPT 4.0使96.30%的文本达到这一水平。ChatGPT 3.5修改后答案的年级水平范围为3.4 - 11.3,ChatGPT 4.0为1 - 8.1。
ChatGPT 3.5和4.0都有效地降低了复杂医学信息的可读性年级水平,ChatGPT 4.0更有效。这表明ChatGPT在促进活体肾捐赠的多样性和公平性方面具有潜在作用,也表明在使医学信息更易获取方面还有进一步优化的空间。