Schmidl Benedikt, Hütten Tobias, Pigorsch Steffi, Stögbauer Fabian, Hoch Cosima C, Hussain Timon, Wollenberg Barbara, Wirth Markus
Department of Otolaryngology Head and Neck Surgery, Technical University Munich, Munich, Germany.
Department of RadioOncology, Technical University Munich, Munich, Germany.
Front Oncol. 2024 May 24;14:1353031. doi: 10.3389/fonc.2024.1353031. eCollection 2024.
Head and neck squamous cell carcinoma (HNSCC) is a complex malignancy that requires a multidisciplinary approach in clinical practice, especially in tumor board discussions. In recent years, artificial intelligence has emerged as a tool to assist healthcare professionals in making informed decisions. This study investigates the application of ChatGPT 3.5 and ChatGPT 4.0, natural language processing models, in tumor board decision-making.
We conducted a pilot study in October 2023 on 20 consecutive head and neck cancer patients discussed in our multidisciplinary tumor board (MDT). Patients with a primary diagnosis of head and neck cancer were included. The MDT and ChatGPT 3.5 and ChatGPT 4.0 recommendations for each patient were compared by two independent reviewers and the number of therapy options, the clinical recommendation, the explanation and the summarization were graded.
In this study, ChatGPT 3.5 provided mostly general answers for surgery, chemotherapy, and radiation therapy. For clinical recommendation, explanation and summarization ChatGPT 3.5 and 4.0 scored well, but demonstrated to be mostly an assisting tool, suggesting significantly more therapy options than our MDT, while some of the recommended treatment modalities like primary immunotherapy are not part of the current treatment guidelines.
This research demonstrates that advanced AI models at the moment can merely assist in the MDT setting, since the current versions list common therapy options, but sometimes recommend incorrect treatment options and in the case of ChatGPT 3.5 lack information on the source material.
头颈部鳞状细胞癌(HNSCC)是一种复杂的恶性肿瘤,在临床实践中需要多学科方法,尤其是在肿瘤病例讨论会上。近年来,人工智能已成为协助医疗保健专业人员做出明智决策的工具。本研究调查了自然语言处理模型ChatGPT 3.5和ChatGPT 4.0在肿瘤病例讨论会决策中的应用。
2023年10月,我们对多学科肿瘤病例讨论会(MDT)中连续讨论的20名头颈部癌症患者进行了一项试点研究。纳入原发性诊断为头颈部癌症的患者。两名独立评审员比较了MDT以及ChatGPT 3.5和ChatGPT 4.0针对每位患者的建议,并对治疗方案数量、临床建议、解释和总结进行了评分。
在本研究中,ChatGPT 3.5针对手术、化疗和放疗大多提供了一般性答案。对于临床建议、解释和总结,ChatGPT 3.5和4.0得分较高,但大多只是辅助工具,其建议的治疗方案比我们的MDT多得多,而一些推荐的治疗方式如原发性免疫疗法并不属于当前治疗指南的范畴。
本研究表明,目前先进的人工智能模型仅能在MDT环境中提供协助,因为当前版本列出了常见的治疗方案,但有时会推荐错误的治疗方案,并且ChatGPT 3.5缺乏关于原始资料的信息。