Dalqvist Emmy, Rancati Tiziana, Embring Anna, Alexandersson von Döbeln Gabriella, Lax Ingmar, Friesland Signe, Onjukka Eva
Department of Oncology Pathology, Karolinska Institutet, Stockholm, Sweden; Department of Nuclear Medicine and Medical Physics, Karolinska University Hospital, Stockholm, Sweden.
Data Science Unit, Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy.
Acta Oncol. 2025 Aug 18;64:1087-1094. doi: 10.2340/1651-226X.2025.43462.
The aim of this study is to validate an Normal Tissue Complication Probability (NTCP) model for xerostomia in a large quality-registry cohort, enabling its future use in individualized NTCP-based treatment planning.
A model predicting grade ≥ 2 xerostomia (6 months post-radiotherapy) was selected for validation, including the mean dose to both the parotid and the submandibular glands, in addition to the baseline score for xerostomia, as predictors. Our local validation cohort consisted of 674 patients (204 events), treated between 2012 and 2024, with a median follow-up of 10.3 months (range 5-24). A closed testing procedure was performed to investigate the need for model updating, and the performance of the models was assessed with calibration curves, discrimination, the Brier score, and the Hosmer-Lemeshow test.
The calibration curve demonstrated that the model predicted the dose-response relationship well. The validation cohort showed a slightly stronger dose response, with a slope of 1.16. The calibration intercept of -0.12 revealed an overestimation of xerostomia. However, the closed testing procedure indicated that a recalibration of the model was needed, and the HL-test showed a significant deviation. The recalibrated model showed perfect calibration but still limited discrimination (Area Under the Curve (AUC) 0.62).
The validated model performed well in our real-life dataset despite the differences between the training and validation cohorts, particularly considering the lack of baseline score in our cohort. This highlights the potential for improved performance with baseline inclusion but still suggests that an individualized NTCP-based treatment-planning protocol can be developed using the recalibrated published model.
本研究旨在在一个大型质量登记队列中验证口腔干燥症的正常组织并发症概率(NTCP)模型,以便其未来能用于基于NTCP的个体化治疗计划。
选择一个预测放疗后6个月≥2级口腔干燥症的模型进行验证,预测因子除了口腔干燥症的基线评分外,还包括腮腺和颌下腺的平均剂量。我们的局部验证队列由674例患者(204例事件)组成,于2012年至2024年接受治疗,中位随访时间为10.3个月(范围5 - 24个月)。进行了封闭测试程序以研究模型更新的必要性,并通过校准曲线、鉴别力、Brier评分和Hosmer-Lemeshow检验评估模型的性能。
校准曲线表明该模型能很好地预测剂量反应关系。验证队列显示剂量反应稍强,斜率为1.16。校准截距为 -0.12表明对口腔干燥症有高估。然而,封闭测试程序表明需要对模型进行重新校准,HL检验显示有显著偏差。重新校准后的模型显示出完美校准,但鉴别力仍然有限(曲线下面积(AUC)为0.62)。
尽管训练队列和验证队列之间存在差异,尤其是考虑到我们队列中缺乏基线评分,但经过验证的模型在我们的真实数据集里表现良好。这突出了纳入基线可提高性能的潜力,但仍表明可以使用重新校准后的已发表模型制定基于NTCP的个体化治疗计划方案。