Johns William L, Kellish Alec, Farronato Dominic, Ciccotti Michael G, Hammoud Sommer
Rothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.
Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.
Arthrosc Sports Med Rehabil. 2024 Feb 13;6(2):100893. doi: 10.1016/j.asmr.2024.100893. eCollection 2024 Apr.
To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction.
A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 "most commonly asked" questions ultimately selected. Questions were presented to ChatGPT and its response was documented. Responses were evaluated independently by 3 authors using an evidence-based methodology, resulting in a grading system categorized as follows: (1) excellent response not requiring clarification; (2) satisfactory requiring minimal clarification; (3) satisfactory requiring moderate clarification; and (4) unsatisfactory requiring substantial clarification.
Six of 10 ten responses were rated as "excellent" or "satisfactory." Of those 6 responses, 2 were determined to be "excellent response not requiring clarification," 3 were "satisfactory requiring minimal clarification," and 1 was "satisfactory requiring moderate clarification." Four questions encompassing inquiries about "What are the potential risks of UCL reconstruction surgery?" "Which type of graft should be used for my UCL reconstruction?" and "Should I have UCL reconstruction or repair?" were rated as "unsatisfactory requiring substantial clarification."
ChatGPT exhibited the potential to improve a patient's basic understanding of UCL reconstruction and provided responses that were deemed satisfactory to excellent for 60% of the most commonly asked questions. For the other 40% of questions, ChatGPT gave unsatisfactory responses, primarily due to a lack of relevant details or the need for further explanation.
ChatGPT can assist in patient education regarding UCL reconstruction; however, its ability to appropriately answer more complex questions remains to be an area of skepticism and future improvement.
确定ChatGPT是否能有效回答关于尺侧副韧带(UCL)重建的10个常见问题。
最初创建了一份包含90个UCL重建问题的综合列表,最终选出10个“最常见”问题。将这些问题呈现给ChatGPT并记录其回答。3位作者使用循证方法对回答进行独立评估,得出如下分级系统:(1)无需澄清的优秀回答;(2)只需最少澄清的满意回答;(3)需要适度澄清的满意回答;(4)需要大量澄清的不满意回答。
10个回答中有6个被评为“优秀”或“满意”。在这6个回答中,2个被确定为“无需澄清的优秀回答”,3个为“只需最少澄清的满意回答”,1个为“需要适度澄清的满意回答”。关于“UCL重建手术有哪些潜在风险?”“我的UCL重建应使用哪种移植物?”以及“我应该进行UCL重建还是修复?”这4个问题的回答被评为“需要大量澄清的不满意回答”。
ChatGPT有潜力提高患者对UCL重建的基本理解,对于60%的最常见问题,其回答被认为是满意到优秀的。对于另外40%的问题,ChatGPT给出的回答不满意,主要是由于缺乏相关细节或需要进一步解释。
ChatGPT可协助进行关于UCL重建的患者教育;然而,其恰当回答更复杂问题的能力仍有待怀疑和未来改进。