Barkan Ella, Porta Camillo, Rabinovici-Cohen Simona, Tibollo Valentina, Quaglini Silvana, Rizzo Mimma
Department of Artificial Intelligence for Accelerated Healthcare & Life Sciences Discovery, IBM Research - Israel, University of Haifa Campus, Haifa, Israel.
Department of Interdisciplinary Medicine, School of Medicine, University of Bari Aldo Moro, Bari, Italy.
Front Oncol. 2023 Feb 16;13:1021684. doi: 10.3389/fonc.2023.1021684. eCollection 2023.
Investigations of the prognosis are vital for better patient management and decision-making in patients with advanced metastatic renal cell carcinoma (mRCC). The purpose of this study is to evaluate the capacity of emerging Artificial Intelligence (AI) technologies to predict three- and five-year overall survival (OS) for mRCC patients starting their first-line of systemic treatment.
The retrospective study included 322 Italian patients with mRCC who underwent systemic treatment between 2004 and 2019. Statistical analysis included the univariate and multivariate Cox proportional-hazard model and the Kaplan-Meier analysis for the prognostic factors' investigation. The patients were split into a training cohort to establish the predictive models and a hold-out cohort to validate the results. The models were evaluated by the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity. We assessed the clinical benefit of the models using decision curve analysis (DCA). Then, the proposed AI models were compared with well-known pre-existing prognostic systems.
The median age of patients in the study was 56.7 years at RCC diagnosis and 78% of participants were male. The median survival time from the start of systemic treatment was 29.2 months; 95% of the patients died during the follow-up that finished by the end of 2019. The proposed predictive model, which was constructed as an ensemble of three individual predictive models, outperformed all well-known prognostic models to which it was compared. It also demonstrated better usability in supporting clinical decisions for 3- and 5-year OS. The model achieved (0.786 and 0.771) AUC and (0.675 and 0.558) specificity at sensitivity 0.90 for 3 and 5 years, respectively. We also applied explainability methods to identify the important clinical features that were found to be partially matched with the prognostic factors identified in the Kaplan-Meier and Cox analyses.
Our AI models provide best predictive accuracy and clinical net benefits over well-known prognostic models. As a result, they can potentially be used in clinical practice for providing better management for mRCC patients starting their first-line of systemic treatment. Larger studies would be needed to validate the developed model.
对于晚期转移性肾细胞癌(mRCC)患者,预后研究对于改善患者管理和决策至关重要。本研究的目的是评估新兴人工智能(AI)技术预测开始一线全身治疗的mRCC患者3年和5年总生存期(OS)的能力。
这项回顾性研究纳入了2004年至2019年间接受全身治疗的322例意大利mRCC患者。统计分析包括单因素和多因素Cox比例风险模型以及用于预后因素研究的Kaplan-Meier分析。患者被分为一个训练队列以建立预测模型,以及一个验证队列以验证结果。通过受试者操作特征曲线(AUC)下的面积、敏感性和特异性对模型进行评估。我们使用决策曲线分析(DCA)评估模型的临床益处。然后,将提出的AI模型与现有的知名预后系统进行比较。
研究中患者的中位年龄在诊断RCC时为56.7岁,78%的参与者为男性。从开始全身治疗起的中位生存时间为29.2个月;95%的患者在2019年底结束的随访期间死亡。所提出的预测模型由三个单独的预测模型组成,其表现优于与之比较的所有知名预后模型。在支持3年和5年OS的临床决策方面,它也表现出更好的实用性。该模型在3年和5年时,敏感性为0.90时,AUC分别为(0.786和0.771),特异性分别为(0.675和0.558)。我们还应用可解释性方法来识别重要的临床特征,发现这些特征与Kaplan-Meier和Cox分析中确定的预后因素部分匹配。
我们的AI模型比知名预后模型具有更好的预测准确性和临床净效益。因此,它们有可能在临床实践中用于为开始一线全身治疗的mRCC患者提供更好的管理。需要更大规模的研究来验证所开发的模型。