• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于脑肿瘤图像分割的多模态特征深度融合

Deep fusion of multi-modal features for brain tumor image segmentation.

作者信息

Zhang Guying, Zhou Jia, He Guanghua, Zhu Hancan

机构信息

School of Mathematics, Physics and Information, Shaoxing University, Shaoxing, Zhejiang, 312000, China.

Cancer Center, Gamma Knife Treatment Center, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, 310014, China.

出版信息

Heliyon. 2023 Aug 18;9(8):e19266. doi: 10.1016/j.heliyon.2023.e19266. eCollection 2023 Aug.

DOI:10.1016/j.heliyon.2023.e19266
PMID:37664757
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10468380/
Abstract

Accurate segmentation of pathological regions in brain magnetic resonance images (MRI) is essential for the diagnosis and treatment of brain tumors. Multi-modality MRIs, which offer diverse feature information, are commonly utilized in brain tumor image segmentation. Deep neural networks have become prevalent in this field; however, many approaches simply concatenate different modalities and input them directly into the neural network for segmentation, disregarding the unique characteristics and complementarity of each modality. In this study, we propose a brain tumor image segmentation method that leverages deep residual learning with multi-modality image feature fusion. Our approach involves extracting and fusing distinct and complementary features from various modalities, fully exploiting the multi-modality information within a deep convolutional neural network to enhance the performance of brain tumor image segmentation. We evaluate the effectiveness of our proposed method using the BraTS2021 dataset and demonstrate that deep residual learning with multi-modality image feature fusion significantly improves segmentation accuracy. Our method achieves competitive segmentation results, with Dice values of 83.3, 89.07, and 91.44 for enhanced tumor, tumor core, and whole tumor, respectively. These findings highlight the potential of our method in improving brain tumor diagnosis and treatment through accurate segmentation of pathological regions in brain MRIs.

摘要

准确分割脑磁共振成像(MRI)中的病理区域对于脑肿瘤的诊断和治疗至关重要。提供多种特征信息的多模态MRI通常用于脑肿瘤图像分割。深度神经网络在该领域已变得普遍;然而,许多方法只是简单地将不同模态连接起来并直接输入到神经网络中进行分割,而忽略了每种模态的独特特征和互补性。在本研究中,我们提出了一种利用深度残差学习和多模态图像特征融合的脑肿瘤图像分割方法。我们的方法包括从各种模态中提取和融合不同且互补的特征,在深度卷积神经网络中充分利用多模态信息以提高脑肿瘤图像分割的性能。我们使用BraTS2021数据集评估了我们提出的方法的有效性,并证明了具有多模态图像特征融合的深度残差学习显著提高了分割精度。我们的方法取得了具有竞争力的分割结果,增强肿瘤、肿瘤核心和全肿瘤的Dice值分别为83.3、89.07和91.44。这些发现突出了我们的方法通过准确分割脑MRI中的病理区域在改善脑肿瘤诊断和治疗方面的潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/511ac268a2b4/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/61d364bd6b97/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/1803826273d1/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/36e13b9cc133/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/511ac268a2b4/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/61d364bd6b97/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/1803826273d1/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/36e13b9cc133/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/17cd/10468380/511ac268a2b4/gr4.jpg

相似文献

1
Deep fusion of multi-modal features for brain tumor image segmentation.用于脑肿瘤图像分割的多模态特征深度融合
Heliyon. 2023 Aug 18;9(8):e19266. doi: 10.1016/j.heliyon.2023.e19266. eCollection 2023 Aug.
2
CMAF-Net: a cross-modal attention fusion-based deep neural network for incomplete multi-modal brain tumor segmentation.CMAF-Net:一种基于跨模态注意力融合的深度神经网络,用于不完全多模态脑肿瘤分割。
Quant Imaging Med Surg. 2024 Jul 1;14(7):4579-4604. doi: 10.21037/qims-24-9. Epub 2024 Jun 27.
3
A 3D hierarchical cross-modality interaction network using transformers and convolutions for brain glioma segmentation in MR images.一种使用变换和卷积的 3D 层次跨模态交互网络,用于磁共振图像中的脑胶质瘤分割。
Med Phys. 2024 Nov;51(11):8371-8389. doi: 10.1002/mp.17354. Epub 2024 Aug 13.
4
Multi-modality self-attention aware deep network for 3D biomedical segmentation.多模态自注意力感知深度网络用于 3D 生物医学分割。
BMC Med Inform Decis Mak. 2020 Jul 9;20(Suppl 3):119. doi: 10.1186/s12911-020-1109-0.
5
MSFR-Net: Multi-modality and single-modality feature recalibration network for brain tumor segmentation.MSFR-Net:用于脑肿瘤分割的多模态和单模态特征重新校准网络。
Med Phys. 2023 Apr;50(4):2249-2262. doi: 10.1002/mp.15933. Epub 2022 Aug 23.
6
Self-Supervised Multi-Modal Hybrid Fusion Network for Brain Tumor Segmentation.基于自监督多模态混合融合网络的脑肿瘤分割。
IEEE J Biomed Health Inform. 2022 Nov;26(11):5310-5320. doi: 10.1109/JBHI.2021.3109301. Epub 2022 Nov 10.
7
Joint learning-based feature reconstruction and enhanced network for incomplete multi-modal brain tumor segmentation.基于联合学习的特征重构和增强网络用于不完全多模态脑肿瘤分割。
Comput Biol Med. 2023 Sep;163:107234. doi: 10.1016/j.compbiomed.2023.107234. Epub 2023 Jul 4.
8
Multi-Modal Brain Tumor Data Completion Based on Reconstruction Consistency Loss.基于重建一致性损失的多模态脑肿瘤数据补全。
J Digit Imaging. 2023 Aug;36(4):1794-1807. doi: 10.1007/s10278-022-00697-6. Epub 2023 Mar 1.
9
Postoperative glioma segmentation in CT image using deep feature fusion model guided by multi-sequence MRIs.基于多序列 MRI 引导的深度特征融合模型的 CT 图像术后脑肿瘤分割。
Eur Radiol. 2020 Feb;30(2):823-832. doi: 10.1007/s00330-019-06441-z. Epub 2019 Oct 24.
10
Automated multi-modal Transformer network (AMTNet) for 3D medical images segmentation.用于3D医学图像分割的自动多模态Transformer网络(AMTNet)。
Phys Med Biol. 2023 Jan 9;68(2). doi: 10.1088/1361-6560/aca74c.

引用本文的文献

1
Advanced finite segmentation model with hybrid classifier learning for high-precision brain tumor delineation in PET imaging.用于PET成像中高精度脑肿瘤轮廓描绘的具有混合分类器学习的先进有限分割模型。
Sci Rep. 2025 Jul 15;15(1):25666. doi: 10.1038/s41598-025-09638-z.
2
Multi-Modality Fusion and Tumor Sub-Component Relationship Ensemble Network for Brain Tumor Segmentation.用于脑肿瘤分割的多模态融合与肿瘤子成分关系集成网络
Bioengineering (Basel). 2025 Feb 6;12(2):159. doi: 10.3390/bioengineering12020159.
3
Application of MRI image segmentation algorithm for brain tumors based on improved YOLO.

本文引用的文献

1
CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer With Modality-Correlated Cross-Attention for Brain Tumor Segmentation.CKD-TransBTS:基于临床知识驱动的混合 Transformer 与模态相关交叉注意力用于脑肿瘤分割。
IEEE Trans Med Imaging. 2023 Aug;42(8):2451-2461. doi: 10.1109/TMI.2023.3250474. Epub 2023 Aug 1.
2
SGEResU-Net for brain tumor segmentation.基于 SGResU-Net 的脑肿瘤分割。
Math Biosci Eng. 2022 Mar 30;19(6):5576-5590. doi: 10.3934/mbe.2022261.
3
nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation.
基于改进YOLO的脑肿瘤MRI图像分割算法的应用
Front Neurosci. 2025 Jan 7;18:1510175. doi: 10.3389/fnins.2024.1510175. eCollection 2024.
4
Implication of tumor morphology and MRI characteristics on the accuracy of automated versus human segmentation of GBM areas.肿瘤形态学和MRI特征对胶质母细胞瘤区域自动分割与人工分割准确性的影响。
Sci Rep. 2025 Jan 16;15(1):2160. doi: 10.1038/s41598-025-85400-9.
nnU-Net:一种基于深度学习的生物医学图像分割的自配置方法。
Nat Methods. 2021 Feb;18(2):203-211. doi: 10.1038/s41592-020-01008-z. Epub 2020 Dec 7.
4
FCN Based Label Correction for Multi-Atlas Guided Organ Segmentation.基于 FCN 的多图谱引导器官分割标签校正。
Neuroinformatics. 2020 Apr;18(2):319-331. doi: 10.1007/s12021-019-09448-5.
5
Dilated Dense U-Net for Infant Hippocampus Subfield Segmentation.用于婴儿海马体亚区域分割的扩张密集U型网络
Front Neuroinform. 2019 Apr 24;13:30. doi: 10.3389/fninf.2019.00030. eCollection 2019.
6
3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation.三维全卷积网络用于同态婴儿脑图像分割。
IEEE Trans Cybern. 2019 Mar;49(3):1123-1136. doi: 10.1109/TCYB.2018.2797905. Epub 2018 Feb 8.
7
A deep learning model integrating FCNNs and CRFs for brain tumor segmentation.基于 FCNNs 和 CRFs 的深度学习模型在脑肿瘤分割中的应用。
Med Image Anal. 2018 Jan;43:98-111. doi: 10.1016/j.media.2017.10.002. Epub 2017 Oct 5.
8
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs.DeepLab:基于深度卷积网络、空洞卷积和全连接条件随机场的语义图像分割。
IEEE Trans Pattern Anal Mach Intell. 2018 Apr;40(4):834-848. doi: 10.1109/TPAMI.2017.2699184. Epub 2017 Apr 27.
9
Fully Convolutional Networks for Semantic Segmentation.全卷积网络用于语义分割。
IEEE Trans Pattern Anal Mach Intell. 2017 Apr;39(4):640-651. doi: 10.1109/TPAMI.2016.2572683. Epub 2016 May 24.
10
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS).多模态脑肿瘤图像分割基准(BRATS)。
IEEE Trans Med Imaging. 2015 Oct;34(10):1993-2024. doi: 10.1109/TMI.2014.2377694. Epub 2014 Dec 4.