Miskiewicz Michael J, Leonardo Christian, Capotosto Salvatore, Ling Kenny, Cohen Dorian, Komatsu David, Wang Edward D
Department of Orthopaedic Surgery, Stony Brook University, Stony Brook, USA.
Department of Orthopaedics, Stony Brook University Hospital, Stony Brook, USA.
Cureus. 2024 May 30;16(5):e61384. doi: 10.7759/cureus.61384. eCollection 2024 May.
Health literacy is a critical determinant of a patient's overall health status, and studies have demonstrated a consistent link between poor health literacy and negative health outcomes. The Centers for Disease Control and Prevention (CDC) and the National Institutes of Health (NIH) advise that patient educational materials (PEMs) should be written at an eighth-grade reading level or lower, matching the average reading level of adult Americans. The purpose of this study was to investigate the ability of generative artificial intelligence (AI) to edit PEMs from orthopaedic institutions to meet the CDC and NIH guidelines.
PEMs about lateral epicondylitis (LE) from the top 25 ranked orthopaedic institutions from the 2022 U.S. News & World Report Best Hospitals Specialty Ranking were gathered. ChatGPT Plus (version 4.0) was then instructed to rewrite PEMs on LE from these institutions to comply with CDC and NIH-recommended guidelines. Readability scores were calculated for the original and rewritten PEMs, and paired t-tests were used to determine statistical significance.
Analysis of the original and edited PEMs about LE revealed significant reductions in reading grade level and word count of 3.70 ± 1.84 (p<0.001) and 346.72 ± 364.63 (p<0.001), respectively.
Our study demonstrated generative AI's ability to rewrite PEM about LE at a reading comprehension level that conforms to the CDC and NIH guidelines. Hospital administrators and orthopaedic surgeons should consider the findings of this study and the potential utility of artificial intelligence when crafting PEMs of their own.
健康素养是患者整体健康状况的关键决定因素,研究表明健康素养低下与不良健康结果之间存在持续的关联。疾病控制与预防中心(CDC)和美国国立卫生研究院(NIH)建议,患者教育材料(PEMs)应以八年级或更低的阅读水平编写,以匹配成年美国人的平均阅读水平。本研究的目的是调查生成式人工智能(AI)编辑骨科机构的PEMs以符合CDC和NIH指南的能力。
收集了2022年《美国新闻与世界报道》最佳医院专科排名中排名前25的骨科机构关于外侧上髁炎(LE)的PEMs。然后指示ChatGPT Plus(版本4.0)重写这些机构关于LE的PEMs,以符合CDC和NIH推荐的指南。计算原始和重写的PEMs的可读性分数,并使用配对t检验确定统计学意义。
对原始和编辑后的关于LE的PEMs的分析显示,阅读年级水平和单词数分别显著降低了3.70±1.84(p<0.001)和346.72±364.63(p<0.001)。
我们的研究证明了生成式人工智能能够以符合CDC和NIH指南的阅读理解水平重写关于LE的PEMs。医院管理人员和骨科医生在编写自己的PEMs时应考虑本研究的结果以及人工智能的潜在效用。