• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

CapNet:一种基于自动注意力机制并带有混合器模型的心血管磁共振图像分割方法

CapNet: An Automatic Attention-Based with Mixer Model for Cardiovascular Magnetic Resonance Image Segmentation.

作者信息

Pham Tien Viet, Vu Tu Ngoc, Le Hoang-Minh-Quang, Pham Van-Truong, Tran Thi-Thao

机构信息

Department of Automation Engineering, School of Electrical and Electronic Engineering, Hanoi University of Science and Technology, Hanoi, Vietnam.

出版信息

J Imaging Inform Med. 2025 Feb;38(1):94-123. doi: 10.1007/s10278-024-01191-x. Epub 2024 Jul 9.

DOI:10.1007/s10278-024-01191-x
PMID:38980628
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11811363/
Abstract

Deep neural networks have shown excellent performance in medical image segmentation, especially for cardiac images. Transformer-based models, though having advantages over convolutional neural networks due to the ability of long-range dependence learning, still have shortcomings such as having a large number of parameters and and high computational cost. Additionally, for better results, they are often pretrained on a larger data, thus requiring large memory size and increasing resource expenses. In this study, we propose a new lightweight but efficient model, namely CapNet, based on convolutions and mixing modules for cardiac segmentation from magnetic resonance images (MRI) that can be trained from scratch with a small amount of parameters. To handle varying sizes and shapes which often occur in cardiac systolic and diastolic phases, we propose attention modules for pooling, spatial, and channel information. We also propose a novel loss called the Tversky Shape Power Distance function based on the shape dissimilarity between labels and predictions that shows promising performances compared to other losses. Experiments on three public datasets including ACDC benchmark, Sunnybrook data, and MS-CMR challenge are conducted and compared with other state of the arts (SOTA). For binary segmentation, the proposed CapNet obtained the Dice similarity coefficient (DSC) of 94% and 95.93% for respectively the Endocardium and Epicardium regions with Sunnybrook dataset, 94.49% for Endocardium, and 96.82% for Epicardium with the ACDC data. Regarding the multiclass case, the average DSC by CapNet is 93.05% for the ACDC data; and the DSC scores for the MS-CMR are 94.59%, 92.22%, and 93.99% for respectively the bSSFP, T2-SPAIR, and LGE sequences of the MS-CMR. Moreover, the statistical significance analysis tests with p-value compared with transformer-based methods and some CNN-based approaches demonstrated that the CapNet, though having fewer training parameters, is statistically significant. The promising evaluation metrics show comparative results in both Dice and IoU indices compared to SOTA CNN-based and Transformer-based architectures.

摘要

深度神经网络在医学图像分割中表现出色,尤其是在心脏图像方面。基于Transformer的模型虽然由于具有长距离依赖学习能力而优于卷积神经网络,但仍存在参数数量多、计算成本高的缺点。此外,为了获得更好的结果,它们通常在更大的数据上进行预训练,因此需要大内存并增加资源开销。在本研究中,我们提出了一种新的轻量级但高效的模型,即CapNet,它基于卷积和混合模块,用于从磁共振图像(MRI)中进行心脏分割,该模型可以用少量参数从头开始训练。为了处理心脏收缩期和舒张期经常出现的不同大小和形状,我们提出了用于池化、空间和通道信息的注意力模块。我们还提出了一种基于标签和预测之间形状差异的新型损失函数,称为Tversky形状功率距离函数,与其他损失函数相比,该函数显示出良好的性能。在包括ACDC基准、Sunnybrook数据和MS-CMR挑战在内的三个公共数据集上进行了实验,并与其他现有技术(SOTA)进行了比较。对于二值分割,在Sunnybrook数据集中,所提出的CapNet在内膜和外膜区域分别获得了94%和95.93%的Dice相似系数(DSC);在ACDC数据中,内膜的DSC为94.49%,外膜的DSC为96.82%。对于多类情况,CapNet在ACDC数据上的平均DSC为93.05%;在MS-CMR中,bSSFP、T2-SPAIR和LGE序列的DSC分数分别为94.59%、92.22%和93.99%。此外,与基于Transformer的方法和一些基于CNN的方法相比,p值的统计显著性分析测试表明,CapNet虽然训练参数较少,但具有统计学意义。与基于SOTA的CNN和Transformer架构相比,这些有前景的评估指标在Dice和IoU指数方面都显示出了比较结果。

相似文献

1
CapNet: An Automatic Attention-Based with Mixer Model for Cardiovascular Magnetic Resonance Image Segmentation.CapNet:一种基于自动注意力机制并带有混合器模型的心血管磁共振图像分割方法
J Imaging Inform Med. 2025 Feb;38(1):94-123. doi: 10.1007/s10278-024-01191-x. Epub 2024 Jul 9.
2
Hybrid method for automatic initialization and segmentation of ventricular on large-scale cardiovascular magnetic resonance images.用于大规模心血管磁共振图像中心室自动初始化和分割的混合方法。
BMC Med Imaging. 2025 May 7;25(1):155. doi: 10.1186/s12880-025-01683-4.
3
Cross-convolutional transformer for automated multi-organs segmentation in a variety of medical images.用于各种医学图像中自动多器官分割的交叉卷积式转换器。
Phys Med Biol. 2023 Jan 23;68(3). doi: 10.1088/1361-6560/acb19a.
4
Abdomen CT multi-organ segmentation using token-based MLP-Mixer.基于令牌的 MLP-Mixer 的腹部 CT 多器官分割。
Med Phys. 2023 May;50(5):3027-3038. doi: 10.1002/mp.16135. Epub 2022 Dec 20.
5
Seg-CapNet: A Capsule-Based Neural Network for the Segmentation of Left Ventricle from Cardiac Magnetic Resonance Imaging.Seg-CapNet:一种基于胶囊网络的用于从心脏磁共振成像中分割左心室的神经网络。
J Comput Sci Technol. 2021;36(2):323-333. doi: 10.1007/s11390-021-0782-5. Epub 2021 Mar 31.
6
Brain tumor segmentation and detection in MRI using convolutional neural networks and VGG16.使用卷积神经网络和VGG16在磁共振成像(MRI)中进行脑肿瘤分割与检测
Cancer Biomark. 2025 Mar;42(3):18758592241311184. doi: 10.1177/18758592241311184. Epub 2025 Apr 4.
7
Efficient Combination of CNN and Transformer for Dual-Teacher Uncertainty-guided Semi-supervised Medical Image Segmentation.基于 CNN 和 Transformer 的高效组合用于双教师不确定性引导的半监督医学图像分割。
Comput Methods Programs Biomed. 2022 Nov;226:107099. doi: 10.1016/j.cmpb.2022.107099. Epub 2022 Sep 2.
8
A quality assurance framework for routine monitoring of deep learning cardiac substructure computed tomography segmentation models in radiotherapy.放疗中深度学习心脏亚结构计算机断层扫描分割模型常规监测的质量保证框架。
Med Phys. 2024 Apr;51(4):2741-2758. doi: 10.1002/mp.16846. Epub 2023 Nov 28.
9
An iterative multi-path fully convolutional neural network for automatic cardiac segmentation in cine MR images.基于迭代多路径全卷积神经网络的心脏电影磁共振图像自动分割方法。
Med Phys. 2019 Dec;46(12):5652-5665. doi: 10.1002/mp.13859. Epub 2019 Nov 1.
10
Automatic segmentation of MRI images for brain radiotherapy planning using deep ensemble learning.使用深度集成学习对脑肿瘤放疗计划的MRI图像进行自动分割
Biomed Phys Eng Express. 2025 Jan 17;11(2). doi: 10.1088/2057-1976/ada6ba.

本文引用的文献

1
BayeSeg: Bayesian modeling for medical image segmentation with interpretable generalizability.BayeSeg:具有可解释泛化能力的医学图像分割贝叶斯建模。
Med Image Anal. 2023 Oct;89:102889. doi: 10.1016/j.media.2023.102889. Epub 2023 Jul 5.
2
BATFormer: Towards Boundary-Aware Lightweight Transformer for Efficient Medical Image Segmentation.BATFormer:面向边界感知的轻量化医学图像分割 Transformer。
IEEE J Biomed Health Inform. 2023 Jul;27(7):3501-3512. doi: 10.1109/JBHI.2023.3266977. Epub 2023 Jun 30.
3
Glomerulus Detection Using Segmentation Neural Networks.使用分割神经网络进行肾小球检测。
J Digit Imaging. 2023 Aug;36(4):1633-1642. doi: 10.1007/s10278-022-00764-y. Epub 2023 Apr 5.
4
MISSFormer: An Effective Transformer for 2D Medical Image Segmentation.MISSFormer:用于二维医学图像分割的有效 Transformer。
IEEE Trans Med Imaging. 2023 May;42(5):1484-1494. doi: 10.1109/TMI.2022.3230943. Epub 2023 May 2.
5
COVID-19 Chest CT Image Segmentation Network by Multi-Scale Fusion and Enhancement Operations.基于多尺度融合与增强操作的COVID-19胸部CT图像分割网络
IEEE Trans Big Data. 2021 Feb 2;7(1):13-24. doi: 10.1109/TBDATA.2021.3056564. eCollection 2021 Mar 1.
6
Two-Stage CNN Whole Heart Segmentation Combining Image Enhanced Attention Mechanism and Metric Classification.两阶段 CNN 全心脏分割结合图像增强注意力机制和度量分类。
J Digit Imaging. 2023 Feb;36(1):124-142. doi: 10.1007/s10278-022-00708-6. Epub 2022 Sep 29.
7
Transformer and group parallel axial attention co-encoder for medical image segmentation.Transformer 和群组并行轴向注意协编码器在医学图像分割中的应用。
Sci Rep. 2022 Sep 27;12(1):16117. doi: 10.1038/s41598-022-20440-z.
8
Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge.多中心、多供应商和多病种心脏分割:M&Ms 挑战赛。
IEEE Trans Med Imaging. 2021 Dec;40(12):3543-3554. doi: 10.1109/TMI.2021.3090082. Epub 2021 Nov 30.
9
Multiscale attention guided U-Net architecture for cardiac segmentation in short-axis MRI images.多尺度注意引导 U-Net 架构在短轴 MRI 图像中的心脏分割。
Comput Methods Programs Biomed. 2021 Jul;206:106142. doi: 10.1016/j.cmpb.2021.106142. Epub 2021 May 4.
10
EAR-UNet: A deep learning-based approach for segmentation of tympanic membranes from otoscopic images.基于深度学习的耳镜鼓膜分割方法
Artif Intell Med. 2021 May;115:102065. doi: 10.1016/j.artmed.2021.102065. Epub 2021 Apr 8.