Shaari Ariana L, Fano Adam N, Anakwenze Oke, Klifto Christopher
Rutgers New Jersey Medical School, Newark, New Jersey, USA.
Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, USA.
Shoulder Elbow. 2024 Jul;16(4):429-435. doi: 10.1177/17585732241259754. Epub 2024 Sep 20.
BACKGROUND: Artificial intelligence (AI) has progressed at a fast pace. ChatGPT, a rapidly expanding AI platform, has several growing applications in medicine and patient care. However, its ability to provide high-quality answers to patient questions about orthopedic procedures such as Tommy John surgery is unknown. Our objective is to evaluate the quality of information provided by ChatGPT 3.5 and 4.0 in response to patient questions regarding Tommy John surgery. METHODS: Twenty-five patient questions regarding Tommy John surgery were posed to ChatGPT 3.5 and 4.0. Readability was assessed via Flesch Kincaid Reading Ease, Flesh Kinkaid Grade Level, Gunning Fog Score, Simple Measure of Gobbledygook, Coleman Liau, and Automated Readability Index. The quality of each response was graded using a 5-point Likert scale. RESULTS: ChatGPT generated information at an educational level that greatly exceeds the recommended level. ChatGPT 4.0 produced slightly better responses to common questions regarding Tommy John surgery with fewer inaccuracies than ChatGPT 3.5. CONCLUSION: Although ChatGPT can provide accurate information regarding Tommy John surgery, its responses may not be easily comprehended by the average patient. As AI platforms become more accessible to the public, patients must be aware of their limitations.
背景:人工智能(AI)发展迅速。ChatGPT作为一个迅速扩张的人工智能平台,在医学和患者护理领域有越来越多的应用。然而,其针对患者有关诸如汤米·约翰手术等骨科手术问题提供高质量答案的能力尚不清楚。我们的目标是评估ChatGPT 3.5和4.0针对患者有关汤米·约翰手术问题所提供信息的质量。 方法:向ChatGPT 3.5和4.0提出25个有关汤米·约翰手术的患者问题。通过弗莱什·金凯德易读性、弗莱什·金凯德年级水平、冈宁雾度得分、简化的晦涩难懂度量、科尔曼·廖指数和自动可读性指数来评估可读性。每个回答的质量使用5点李克特量表进行评分。 结果:ChatGPT生成的信息在教育水平上大大超过了推荐水平。ChatGPT 4.0对有关汤米·约翰手术的常见问题给出的回答略好,不准确之处比ChatGPT 3.5少。 结论:虽然ChatGPT可以提供有关汤米·约翰手术的准确信息,但其回答普通患者可能不易理解。随着人工智能平台越来越为公众所用,患者必须意识到它们的局限性。
Clin Spine Surg. 2024-7-1
J Pediatr Ophthalmol Strabismus. 2025
Ann Allergy Asthma Immunol. 2025-7
Hand (N Y). 2024-4-23
Laryngoscope Investig Otolaryngol. 2025-3-22
Int J Ther Massage Bodywork. 2023-12-1
J Am Acad Orthop Surg Glob Res Rev. 2023-11-1