• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于注意力机制的多模态协同学习用于FDG PET-CT上的头颈部肿瘤分割

Multi-modal co-learning with attention mechanism for head and neck tumor segmentation on FDG PET-CT.

作者信息

Cho Min Jeong, Hwang Donghwi, Yie Si Young, Lee Jae Sung

机构信息

Interdisciplinary Program in Bioengineering, Seoul National University College of Engineering, Seoul, 03080, South Korea.

Department of Nuclear Medicine, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.

出版信息

EJNMMI Phys. 2024 Jul 25;11(1):67. doi: 10.1186/s40658-024-00670-y.

DOI:10.1186/s40658-024-00670-y
PMID:39052194
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11272764/
Abstract

PURPOSE

Effective radiation therapy requires accurate segmentation of head and neck cancer, one of the most common types of cancer. With the advancement of deep learning, people have come up with various methods that use positron emission tomography-computed tomography to get complementary information. However, these approaches are computationally expensive because of the separation of feature extraction and fusion functions and do not make use of the high sensitivity of PET. We propose a new deep learning-based approach to alleviate these challenges.

METHODS

We proposed a tumor region attention module that fully exploits the high sensitivity of PET and designed a network that learns the correlation between the PET and CT features using squeeze-and-excitation normalization (SE Norm) without separating the feature extraction and fusion functions. In addition, we introduce multi-scale context fusion, which exploits contextual information from different scales.

RESULTS

The HECKTOR challenge 2021 dataset was used for training and testing. The proposed model outperformed the state-of-the-art models for medical image segmentation; in particular, the dice similarity coefficient increased by 8.78% compared to U-net.

CONCLUSION

The proposed network segmented the complex shape of the tumor better than the state-of-the-art medical image segmentation methods, accurately distinguishing between tumor and non-tumor regions.

摘要

目的

有效的放射治疗需要对头颈部癌(最常见的癌症类型之一)进行精确分割。随着深度学习的发展,人们提出了各种利用正电子发射断层扫描-计算机断层扫描来获取补充信息的方法。然而,由于特征提取和融合功能的分离,这些方法计算成本高昂,且未利用PET的高灵敏度。我们提出一种基于深度学习的新方法来应对这些挑战。

方法

我们提出了一种肿瘤区域注意力模块,该模块充分利用PET的高灵敏度,并设计了一个网络,使用挤压激励归一化(SE Norm)来学习PET和CT特征之间的相关性,而不分离特征提取和融合功能。此外,我们引入了多尺度上下文融合,利用来自不同尺度的上下文信息。

结果

使用HECKTOR挑战2021数据集进行训练和测试。所提出的模型在医学图像分割方面优于现有模型;特别是,与U-net相比,骰子相似系数提高了8.78%。

结论

所提出的网络在分割肿瘤的复杂形状方面优于现有医学图像分割方法,能够准确区分肿瘤和非肿瘤区域。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/f305de0ca118/40658_2024_670_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/23f37800a1f1/40658_2024_670_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/17c05f241e3d/40658_2024_670_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/c1ebc431bd38/40658_2024_670_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/5850d8111850/40658_2024_670_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/114f7d0b060c/40658_2024_670_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/632f2bf4e791/40658_2024_670_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/fa2b99d3a035/40658_2024_670_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/f305de0ca118/40658_2024_670_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/23f37800a1f1/40658_2024_670_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/17c05f241e3d/40658_2024_670_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/c1ebc431bd38/40658_2024_670_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/5850d8111850/40658_2024_670_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/114f7d0b060c/40658_2024_670_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/632f2bf4e791/40658_2024_670_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/fa2b99d3a035/40658_2024_670_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba44/11272764/f305de0ca118/40658_2024_670_Fig8_HTML.jpg

相似文献

1
Multi-modal co-learning with attention mechanism for head and neck tumor segmentation on FDG PET-CT.基于注意力机制的多模态协同学习用于FDG PET-CT上的头颈部肿瘤分割
EJNMMI Phys. 2024 Jul 25;11(1):67. doi: 10.1186/s40658-024-00670-y.
2
SwinCross: Cross-modal Swin transformer for head-and-neck tumor segmentation in PET/CT images.SwinCross:用于 PET/CT 图像中头颈部肿瘤分割的跨模态 Swin 变换器。
Med Phys. 2024 Mar;51(3):2096-2107. doi: 10.1002/mp.16703. Epub 2023 Sep 30.
3
MSRA-Net: Tumor segmentation network based on Multi-scale Residual Attention.MSRA-Net:基于多尺度残差注意力的肿瘤分割网络。
Comput Biol Med. 2023 May;158:106818. doi: 10.1016/j.compbiomed.2023.106818. Epub 2023 Mar 22.
4
LSAM: L2-norm self-attention and latent space feature interaction for automatic 3D multi-modal head and neck tumor segmentation.LSAM:用于自动 3D 多模态头颈部肿瘤分割的 L2-范数自注意力和潜在空间特征交互。
Phys Med Biol. 2023 Nov 6;68(22). doi: 10.1088/1361-6560/ad04a8.
5
DMCT-Net: dual modules convolution transformer network for head and neck tumor segmentation in PET/CT.DMCT-Net:用于 PET/CT 中头颈部肿瘤分割的双模块卷积变换网络。
Phys Med Biol. 2023 May 22;68(11). doi: 10.1088/1361-6560/acd29f.
6
MFCNet: A multi-modal fusion and calibration networks for 3D pancreas tumor segmentation on PET-CT images.MFCNet:一种用于PET-CT图像上3D胰腺肿瘤分割的多模态融合与校准网络。
Comput Biol Med. 2023 Mar;155:106657. doi: 10.1016/j.compbiomed.2023.106657. Epub 2023 Feb 10.
7
ISA-Net: Improved spatial attention network for PET-CT tumor segmentation.ISA-Net:用于 PET-CT 肿瘤分割的改进空间注意网络。
Comput Methods Programs Biomed. 2022 Nov;226:107129. doi: 10.1016/j.cmpb.2022.107129. Epub 2022 Sep 16.
8
Information fusion for fully automated segmentation of head and neck tumors from PET and CT images.基于 PET 和 CT 图像的头颈部肿瘤全自动分割的信息融合。
Med Phys. 2024 Jan;51(1):319-333. doi: 10.1002/mp.16615. Epub 2023 Jul 20.
9
DGCBG-Net: A dual-branch network with global cross-modal interaction and boundary guidance for tumor segmentation in PET/CT images.DGCBG-Net:一种具有全局跨模态交互和边界引导的双分支网络,用于 PET/CT 图像中的肿瘤分割。
Comput Methods Programs Biomed. 2024 Jun;250:108125. doi: 10.1016/j.cmpb.2024.108125. Epub 2024 Mar 20.
10
Joint segmentation of tumors in 3D PET-CT images with a network fusing multi-view and multi-modal information.三维 PET-CT 图像中肿瘤的联合分割,融合多视图和多模态信息的网络。
Phys Med Biol. 2024 Oct 7;69(20). doi: 10.1088/1361-6560/ad7f1b.

本文引用的文献

1
Multi-Modal Co-Learning for Liver Lesion Segmentation on PET-CT Images.多模态联合学习在 PET-CT 图像上进行肝脏病变分割。
IEEE Trans Med Imaging. 2021 Dec;40(12):3531-3542. doi: 10.1109/TMI.2021.3089702. Epub 2021 Nov 30.
2
Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation.用于靶向多模态 PET-CT 肺肿瘤分割的多模态空间注意模块。
IEEE J Biomed Health Inform. 2021 Sep;25(9):3507-3516. doi: 10.1109/JBHI.2021.3059453. Epub 2021 Sep 3.
3
Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries.
《全球癌症统计数据 2020:全球 185 个国家和地区 36 种癌症的发病率和死亡率估计》。
CA Cancer J Clin. 2021 May;71(3):209-249. doi: 10.3322/caac.21660. Epub 2021 Feb 4.
4
CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation.CA-Net:用于可解释医学图像分割的综合注意力卷积神经网络。
IEEE Trans Med Imaging. 2021 Feb;40(2):699-711. doi: 10.1109/TMI.2020.3035253. Epub 2021 Feb 2.
5
Deep-dose: a voxel dose estimation method using deep convolutional neural network for personalized internal dosimetry.深剂量:一种使用深度卷积神经网络进行个体化内剂量估算的体素剂量估计方法。
Sci Rep. 2019 Jul 16;9(1):10308. doi: 10.1038/s41598-019-46620-y.
6
Co-Learning Feature Fusion Maps from PET-CT Images of Lung Cancer.从肺癌PET-CT图像中共同学习特征融合图
IEEE Trans Med Imaging. 2019 Jun 17. doi: 10.1109/TMI.2019.2923601.
7
Measurement of Glomerular Filtration Rate using Quantitative SPECT/CT and Deep-learning-based Kidney Segmentation.使用定量 SPECT/CT 和基于深度学习的肾脏分割测量肾小球滤过率。
Sci Rep. 2019 Mar 12;9(1):4223. doi: 10.1038/s41598-019-40710-7.
8
CE-Net: Context Encoder Network for 2D Medical Image Segmentation.CE-Net:用于二维医学图像分割的上下文编码器网络。
IEEE Trans Med Imaging. 2019 Oct;38(10):2281-2292. doi: 10.1109/TMI.2019.2903562. Epub 2019 Mar 7.
9
Radiomics in Oncological PET/CT: a Methodological Overview.肿瘤PET/CT中的放射组学:方法学概述。
Nucl Med Mol Imaging. 2019 Feb;53(1):14-29. doi: 10.1007/s13139-019-00571-4. Epub 2019 Jan 15.
10
Simultaneous cosegmentation of tumors in PET-CT images using deep fully convolutional networks.使用深度全卷积网络对 PET-CT 图像中的肿瘤进行同时分割。
Med Phys. 2019 Feb;46(2):619-633. doi: 10.1002/mp.13331. Epub 2019 Jan 4.