Karabuğa Berkan, Karaçin Cengiz, Büyükkör Mustafa, Bayram Doğan, Aydemir Ergin, Kaya Osman Bilge, Yılmaz Mehmet Emin, Çamöz Elif Sertesen, Ergün Yakup
Department of Medical Oncology, Dr. Abdurrahman Yurtaslan Ankara Oncology Research and Training Hospital, 06200 Ankara, Turkey.
Department of Medical Oncology, Gülhane Research and Training Hospital, 06010 Ankara, Turkey.
J Clin Med. 2025 May 18;14(10):3535. doi: 10.3390/jcm14103535.
Artificial intelligence (AI) has emerged as a promising field in the era of personalized oncology due to its potential to save time and workforce while serving as a supportive tool in patient management decisions. Although several studies in the literature have explored the integration of AI into oncology practice across different tumor types, available data remain limited. In our study, we aimed to evaluate the role of AI in the management of complex cancer cases by comparing the decisions of an in-house tumor board and ChatGPT-4o for patients with various tumor types. A total of 102 patients with diverse cancer types were included. Treatment and follow-up decisions proposed by both the tumor board and ChatGPT-4o were independently evaluated by two medical oncologists using a 5-point Likert scale. Analysis of agreement levels showed high inter-rater reliability (κ = 0.722, < 0.001 for tumor board decisions; κ = 0.794, < 0.001 for ChatGPT decisions). However, concordance between the tumor board and ChatGPT was low, as reflected in the assessments of both raters (Rater 1: κ = 0.211, = 0.003; Rater 2: κ = 0.376, < 0.001). Both raters more frequently agreed with the tumor board decisions, and a statistically significant difference between tumor board and AI decisions was observed for both (Rater 1: Z = +4.548, < 0.001; Rater 2: Z = +3.990, < 0.001). These findings suggest that AI, in its current form, is not yet capable of functioning as a standalone decision-maker in the management of challenging oncology cases. Clinical experience and expert judgment remain the most critical factors in guiding patient care.
在个性化肿瘤学时代,人工智能(AI)已成为一个充满前景的领域,因为它有潜力节省时间和人力,同时在患者管理决策中作为一种辅助工具。尽管文献中的多项研究探讨了将人工智能整合到不同肿瘤类型的肿瘤学实践中,但可用数据仍然有限。在我们的研究中,我们旨在通过比较内部肿瘤委员会和ChatGPT-4o对不同肿瘤类型患者的决策,来评估人工智能在复杂癌症病例管理中的作用。总共纳入了102例患有不同癌症类型的患者。肿瘤委员会和ChatGPT-4o提出的治疗和随访决策由两名医学肿瘤学家使用5点李克特量表进行独立评估。一致性水平分析显示评分者间信度较高(肿瘤委员会决策的κ = 0.722,P < 0.001;ChatGPT决策的κ = 0.794,P < 0.001)。然而,肿瘤委员会和ChatGPT之间的一致性较低,两位评分者的评估均反映了这一点(评分者1:κ = 0.211,P = 0.003;评分者2:κ = 0.376,P < 0.001)。两位评分者更频繁地认同肿瘤委员会的决策,并且在两者之间观察到肿瘤委员会和人工智能决策存在统计学显著差异(评分者1:Z = +4.548,P < 0.001;评分者2:Z = +3.990,P < 0.001)。这些发现表明,目前形式的人工智能在具有挑战性的肿瘤病例管理中尚不能作为独立的决策制定者发挥作用。临床经验和专家判断仍然是指导患者护理的最关键因素。
Eur Arch Otorhinolaryngol. 2025-3
Clin Transl Oncol. 2025-3-25