• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

结合卷积神经网络和视觉Transformer的多任务学习可改善头颈癌患者的预后预测。

Multitask Learning with Convolutional Neural Networks and Vision Transformers Can Improve Outcome Prediction for Head and Neck Cancer Patients.

作者信息

Starke Sebastian, Zwanenburg Alex, Leger Karoline, Lohaus Fabian, Linge Annett, Kalinauskaite Goda, Tinhofer Inge, Guberina Nika, Guberina Maja, Balermpas Panagiotis, Grün Jens von der, Ganswindt Ute, Belka Claus, Peeken Jan C, Combs Stephanie E, Boeke Simon, Zips Daniel, Richter Christian, Troost Esther G C, Krause Mechthild, Baumann Michael, Löck Steffen

机构信息

Helmholtz-Zentrum Dresden-Rossendorf, Department of Information Services and Computing, 01328 Dresden, Germany.

OncoRay-National Center for Radiation Research in Oncology, Faculty of Medicine and University Hospital Carl Gustav Carus, Technische Universität Dresden, Helmholtz-Zentrum Dresden-Rossendorf, 01309 Dresden, Germany.

出版信息

Cancers (Basel). 2023 Oct 9;15(19):4897. doi: 10.3390/cancers15194897.

DOI:10.3390/cancers15194897
PMID:37835591
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10571894/
Abstract

Neural-network-based outcome predictions may enable further treatment personalization of patients with head and neck cancer. The development of neural networks can prove challenging when a limited number of cases is available. Therefore, we investigated whether multitask learning strategies, implemented through the simultaneous optimization of two distinct outcome objectives (multi-outcome) and combined with a tumor segmentation task, can lead to improved performance of convolutional neural networks (CNNs) and vision transformers (ViTs). Model training was conducted on two distinct multicenter datasets for the endpoints loco-regional control (LRC) and progression-free survival (PFS), respectively. The first dataset consisted of pre-treatment computed tomography (CT) imaging for 290 patients and the second dataset contained combined positron emission tomography (PET)/CT data of 224 patients. Discriminative performance was assessed by the concordance index (C-index). Risk stratification was evaluated using log-rank tests. Across both datasets, CNN and ViT model ensembles achieved similar results. Multitask approaches showed favorable performance in most investigations. Multi-outcome CNN models trained with segmentation loss were identified as the optimal strategy across cohorts. On the PET/CT dataset, an ensemble of multi-outcome CNNs trained with segmentation loss achieved the best discrimination (C-index: 0.29, 95% confidence interval (CI): 0.22-0.36) and successfully stratified patients into groups with low and high risk of disease progression (p=0.003). On the CT dataset, ensembles of multi-outcome CNNs and of single-outcome ViTs trained with segmentation loss performed best (C-index: 0.26 and 0.26, CI: 0.18-0.34 and 0.18-0.35, respectively), both with significant risk stratification for LRC in independent validation (p=0.002 and p=0.011). Further validation of the developed multitask-learning models is planned based on a prospective validation study, which has recently completed recruitment.

摘要

基于神经网络的预后预测可能会使头颈癌患者的治疗更加个性化。当可用病例数量有限时,神经网络的开发可能会面临挑战。因此,我们研究了通过同时优化两个不同的预后目标(多预后)并结合肿瘤分割任务来实施的多任务学习策略,是否能够提高卷积神经网络(CNN)和视觉Transformer(ViT)的性能。分别在两个不同的多中心数据集上进行模型训练,以局部区域控制(LRC)和无进展生存期(PFS)为终点。第一个数据集由290例患者的治疗前计算机断层扫描(CT)成像组成,第二个数据集包含224例患者的正电子发射断层扫描(PET)/CT联合数据。通过一致性指数(C指数)评估判别性能。使用对数秩检验评估风险分层。在两个数据集中,CNN和ViT模型集成取得了相似的结果。多任务方法在大多数研究中表现出良好的性能。在各个队列中,使用分割损失训练的多预后CNN模型被确定为最佳策略。在PET/CT数据集上,使用分割损失训练的多预后CNN集成实现了最佳判别(C指数:0.29,95%置信区间(CI):0.22-0.36),并成功将患者分为疾病进展低风险和高风险组(p=0.003)。在CT数据集上,使用分割损失训练的多预后CNN和单预后ViT集成表现最佳(C指数分别为0.26和0.26,CI分别为0.18-0.34和0.18-0.35),两者在独立验证中对LRC均有显著的风险分层(p=0.002和p=0.011)。计划基于一项前瞻性验证研究对所开发的多任务学习模型进行进一步验证,该研究最近已完成招募。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/0ad78ca968c2/cancers-15-04897-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/0d8402958627/cancers-15-04897-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/d008613f3f7d/cancers-15-04897-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/c0575a1b0eb2/cancers-15-04897-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/901458080771/cancers-15-04897-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/b53e46fad3a0/cancers-15-04897-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/0ad78ca968c2/cancers-15-04897-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/0d8402958627/cancers-15-04897-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/d008613f3f7d/cancers-15-04897-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/c0575a1b0eb2/cancers-15-04897-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/901458080771/cancers-15-04897-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/b53e46fad3a0/cancers-15-04897-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ca5b/10571894/0ad78ca968c2/cancers-15-04897-g006.jpg

相似文献

1
Multitask Learning with Convolutional Neural Networks and Vision Transformers Can Improve Outcome Prediction for Head and Neck Cancer Patients.结合卷积神经网络和视觉Transformer的多任务学习可改善头颈癌患者的预后预测。
Cancers (Basel). 2023 Oct 9;15(19):4897. doi: 10.3390/cancers15194897.
2
Head and Neck Cancer Segmentation in FDG PET Images: Performance Comparison of Convolutional Neural Networks and Vision Transformers.头颈部癌症在 FDG PET 图像中的分割:卷积神经网络与视觉转换器的性能比较。
Tomography. 2023 Oct 18;9(5):1933-1948. doi: 10.3390/tomography9050151.
3
MuSiC-ViT: A multi-task Siamese convolutional vision transformer for differentiating change from no-change in follow-up chest radiographs.MuSiC-ViT:一种用于区分随访胸部 X 光片上变化与无变化的多任务暹罗卷积视觉Transformer。
Med Image Anal. 2023 Oct;89:102894. doi: 10.1016/j.media.2023.102894. Epub 2023 Jul 12.
4
Outcome and Biomarker Supervised Deep Learning for Survival Prediction in Two Multicenter Breast Cancer Series.两个多中心乳腺癌系列中用于生存预测的结局与生物标志物监督深度学习
J Pathol Inform. 2022 Jan 18;13:9. doi: 10.4103/jpi.jpi_29_21. eCollection 2022.
5
Detecting Tuberculosis-Consistent Findings in Lateral Chest X-Rays Using an Ensemble of CNNs and Vision Transformers.使用卷积神经网络(CNN)和视觉Transformer的集成在胸部侧位X光片中检测与肺结核一致的表现。
Front Genet. 2022 Feb 24;13:864724. doi: 10.3389/fgene.2022.864724. eCollection 2022.
6
Enhancing surgical instrument segmentation: integrating vision transformer insights with adapter.增强手术器械分割:结合视觉Transformer 见解与适配器。
Int J Comput Assist Radiol Surg. 2024 Jul;19(7):1313-1320. doi: 10.1007/s11548-024-03140-z. Epub 2024 May 8.
7
PET/CT based transformer model for multi-outcome prediction in oropharyngeal cancer.基于 PET/CT 的头颈部鳞状细胞癌多结局预测的变压器模型。
Radiother Oncol. 2024 Aug;197:110368. doi: 10.1016/j.radonc.2024.110368. Epub 2024 Jun 2.
8
BUViTNet: Breast Ultrasound Detection via Vision Transformers.BUViTNet:通过视觉Transformer进行乳腺超声检测
Diagnostics (Basel). 2022 Nov 1;12(11):2654. doi: 10.3390/diagnostics12112654.
9
A convolutional neural network algorithm for automatic segmentation of head and neck organs at risk using deep lifelong learning.一种使用深度终身学习的自动分割头颈部危险器官的卷积神经网络算法。
Med Phys. 2019 May;46(5):2204-2213. doi: 10.1002/mp.13495. Epub 2019 Apr 4.
10
Comparative Analysis of Vision Transformers and Conventional Convolutional Neural Networks in Detecting Referable Diabetic Retinopathy.视觉Transformer与传统卷积神经网络在检测可转诊糖尿病视网膜病变中的对比分析
Ophthalmol Sci. 2024 May 17;4(6):100552. doi: 10.1016/j.xops.2024.100552. eCollection 2024 Nov-Dec.

引用本文的文献

1
End-to-end prediction of clinical outcomes in head and neck squamous cell carcinoma with foundation model-based multiple instance learning.基于基础模型的多实例学习对头颈部鳞状细胞癌临床结局的端到端预测
BMC Artif Intell. 2025;1(1):3. doi: 10.1186/s44398-025-00003-8. Epub 2025 Jun 24.
2
End-to-end prediction of clinical outcomes in head and neck squamous cell carcinoma with foundation model-based multiple instance learning.基于基础模型的多实例学习对头颈部鳞状细胞癌临床结局的端到端预测
medRxiv. 2025 Jan 25:2025.01.22.25320517. doi: 10.1101/2025.01.22.25320517.
3
Novel pre-spatial data fusion deep learning approach for multimodal volumetric outcome prediction models in radiotherapy.

本文引用的文献

1
Survival prediction models: an introduction to discrete-time modeling.生存预测模型:离散时间建模简介。
BMC Med Res Methodol. 2022 Jul 26;22(1):207. doi: 10.1186/s12874-022-01679-6.
2
DeepMTS: Deep Multi-Task Learning for Survival Prediction in Patients With Advanced Nasopharyngeal Carcinoma Using Pretreatment PET/CT.DeepMTS:基于预处理 PET/CT 的晚期鼻咽癌患者生存预测的深度多任务学习
IEEE J Biomed Health Inform. 2022 Sep;26(9):4497-4507. doi: 10.1109/JBHI.2022.3181791. Epub 2022 Sep 9.
3
Testing the Ability of Convolutional Neural Networks to Learn Radiomic Features.
用于放射治疗中多模态容积结果预测模型的新型空间前数据融合深度学习方法。
Med Phys. 2025 Apr;52(4):2675-2687. doi: 10.1002/mp.17672. Epub 2025 Feb 10.
4
Artificial Intelligence in Head and Neck Cancer: Innovations, Applications, and Future Directions.人工智能在头颈部肿瘤中的应用:创新、应用和未来方向。
Curr Oncol. 2024 Sep 6;31(9):5255-5290. doi: 10.3390/curroncol31090389.
5
Integrating a deep neural network and Transformer architecture for the automatic segmentation and survival prediction in cervical cancer.将深度神经网络与Transformer架构相结合用于宫颈癌的自动分割和生存预测。
Quant Imaging Med Surg. 2024 Aug 1;14(8):5408-5419. doi: 10.21037/qims-24-560. Epub 2024 Jul 16.
测试卷积神经网络学习放射组学特征的能力。
Comput Methods Programs Biomed. 2022 Jun;219:106750. doi: 10.1016/j.cmpb.2022.106750. Epub 2022 Mar 17.
4
Head and neck tumor segmentation in PET/CT: The HECKTOR challenge.头颈部肿瘤在 PET/CT 中的分割:HECKTOR 挑战赛。
Med Image Anal. 2022 Apr;77:102336. doi: 10.1016/j.media.2021.102336. Epub 2021 Dec 25.
5
Multi-task deep learning network to predict future macrovascular invasion in hepatocellular carcinoma.用于预测肝细胞癌未来大血管侵犯的多任务深度学习网络。
EClinicalMedicine. 2021 Dec 9;42:101201. doi: 10.1016/j.eclinm.2021.101201. eCollection 2021 Dec.
6
Multi-task vision transformer using low-level chest X-ray feature corpus for COVID-19 diagnosis and severity quantification.多任务视觉转换器利用低水平胸部 X 射线特征语料库进行 COVID-19 诊断和严重程度量化。
Med Image Anal. 2022 Jan;75:102299. doi: 10.1016/j.media.2021.102299. Epub 2021 Nov 4.
7
Predicting treatment response from longitudinal images using multi-task deep learning.利用多任务深度学习从纵向图像预测治疗反应。
Nat Commun. 2021 Mar 25;12(1):1851. doi: 10.1038/s41467-021-22188-y.
8
Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries.《全球癌症统计数据 2020:全球 185 个国家和地区 36 种癌症的发病率和死亡率估计》。
CA Cancer J Clin. 2021 May;71(3):209-249. doi: 10.3322/caac.21660. Epub 2021 Feb 4.
9
Head and neck squamous cell carcinoma.头颈部鳞状细胞癌
Nat Rev Dis Primers. 2020 Nov 26;6(1):92. doi: 10.1038/s41572-020-00224-3.
10
Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation.基于多任务深度学习的 COVID-19 肺炎 CT 成像分析:分类与分割。
Comput Biol Med. 2020 Nov;126:104037. doi: 10.1016/j.compbiomed.2020.104037. Epub 2020 Oct 8.