• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

RFE-UNet:用于医学图像分割的远程特征探索与局部学习。

RFE-UNet: Remote Feature Exploration with Local Learning for Medical Image Segmentation.

机构信息

College of Information Science and Engineering, Xinjiang University, Urumqi 830049, China.

出版信息

Sensors (Basel). 2023 Jul 7;23(13):6228. doi: 10.3390/s23136228.

DOI:10.3390/s23136228
PMID:37448077
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10346146/
Abstract

Although convolutional neural networks (CNNs) have produced great achievements in various fields, many scholars are still exploring better network models, since CNNs have an inherent limitation-that is, the remote modeling ability of convolutional kernels is limited. On the contrary, the transformer has been applied by many scholars to the field of vision, and although it has a strong global modeling capability, its close-range modeling capability is mediocre. While the foreground information to be segmented in medical images is usually clustered in a small interval in the image, the distance between different categories of foreground information is uncertain. Therefore, in order to obtain a perfect medical segmentation prediction graph, the network should not only have a strong learning ability for local details, but also have a certain distance modeling ability. To solve these problems, a remote feature exploration (RFE) module is proposed in this paper. The most important feature of this module is that remote elements can be used to assist in the generation of local features. In addition, in order to better verify the feasibility of the innovation in this paper, a new multi-organ segmentation dataset (MOD) was manually created. While both the MOD and Synapse datasets label eight categories of organs, there are some images in the Synapse dataset that label only a few categories of organs. The proposed method achieved 79.77% and 75.12% DSC on the Synapse and MOD datasets, respectively. Meanwhile, the 95 (mm) scores were 21.75 on Synapse and 7.43 on the MOD dataset.

摘要

尽管卷积神经网络 (CNN) 在各个领域取得了巨大成就,但许多学者仍在探索更好的网络模型,因为 CNN 存在固有局限性——即卷积核的远程建模能力有限。相比之下,许多学者已经将 Transformer 应用于视觉领域,尽管它具有很强的全局建模能力,但它的近距离建模能力却很平庸。而医学图像中要分割的前景信息通常在图像的小间隔内聚类,不同类别的前景信息之间的距离是不确定的。因此,为了获得完美的医学分割预测图,网络不仅应该具有很强的局部细节学习能力,还应该具有一定的距离建模能力。为了解决这些问题,本文提出了一种远程特征探索 (RFE) 模块。该模块最重要的特点是可以利用远程元素来辅助生成局部特征。此外,为了更好地验证本文创新的可行性,还手动创建了一个新的多器官分割数据集 (MOD)。虽然 Synapse 和 MOD 数据集都对 8 类器官进行了标注,但 Synapse 数据集中的一些图像只标注了少数几类器官。所提出的方法在 Synapse 和 MOD 数据集上的 DSC 分别达到了 79.77%和 75.12%。同时,Synapse 数据集上的 95(mm)评分是 21.75,MOD 数据集上的评分是 7.43。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/08fe29996648/sensors-23-06228-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/34ba14d1c5b5/sensors-23-06228-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/425842aedacf/sensors-23-06228-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/604b4922d90f/sensors-23-06228-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/25153fe62269/sensors-23-06228-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/351520f05af5/sensors-23-06228-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/14c1cd04cd47/sensors-23-06228-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/08fe29996648/sensors-23-06228-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/34ba14d1c5b5/sensors-23-06228-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/425842aedacf/sensors-23-06228-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/604b4922d90f/sensors-23-06228-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/25153fe62269/sensors-23-06228-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/351520f05af5/sensors-23-06228-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/14c1cd04cd47/sensors-23-06228-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/aa2d/10346146/08fe29996648/sensors-23-06228-g007.jpg

相似文献

1
RFE-UNet: Remote Feature Exploration with Local Learning for Medical Image Segmentation.RFE-UNet:用于医学图像分割的远程特征探索与局部学习。
Sensors (Basel). 2023 Jul 7;23(13):6228. doi: 10.3390/s23136228.
2
MESTrans: Multi-scale embedding spatial transformer for medical image segmentation.MESTrans:用于医学图像分割的多尺度嵌入空间变换器
Comput Methods Programs Biomed. 2023 May;233:107493. doi: 10.1016/j.cmpb.2023.107493. Epub 2023 Mar 17.
3
Cross-convolutional transformer for automated multi-organs segmentation in a variety of medical images.用于各种医学图像中自动多器官分割的交叉卷积式转换器。
Phys Med Biol. 2023 Jan 23;68(3). doi: 10.1088/1361-6560/acb19a.
4
Land Cover Classification of UAV Remote Sensing Based on Transformer-CNN Hybrid Architecture.基于 Transformer-CNN 混合架构的无人机遥感土地覆盖分类。
Sensors (Basel). 2023 Jun 2;23(11):5288. doi: 10.3390/s23115288.
5
Dual encoder network with transformer-CNN for multi-organ segmentation.基于 Transformer-CNN 的双编码器网络的多器官分割。
Med Biol Eng Comput. 2023 Mar;61(3):661-671. doi: 10.1007/s11517-022-02723-9. Epub 2022 Dec 29.
6
ConvWin-UNet: UNet-like hierarchical vision Transformer combined with convolution for medical image segmentation.卷积窗口U-Net:结合卷积的类U-Net层次视觉Transformer用于医学图像分割
Math Biosci Eng. 2023 Jan;20(1):128-144. doi: 10.3934/mbe.2023007. Epub 2022 Sep 29.
7
ST-Unet: Swin Transformer boosted U-Net with Cross-Layer Feature Enhancement for medical image segmentation.ST-Unet:具有跨层特征增强的 Swin Transformer 增强型 U-Net,用于医学图像分割。
Comput Biol Med. 2023 Feb;153:106516. doi: 10.1016/j.compbiomed.2022.106516. Epub 2023 Jan 6.
8
BPAT-UNet: Boundary preserving assembled transformer UNet for ultrasound thyroid nodule segmentation.BPAT-UNet:用于超声甲状腺结节分割的边界保持组装 Transformer UNet。
Comput Methods Programs Biomed. 2023 Aug;238:107614. doi: 10.1016/j.cmpb.2023.107614. Epub 2023 May 19.
9
P-TransUNet: an improved parallel network for medical image segmentation.P-TransUNet:一种用于医学图像分割的改进并行网络。
BMC Bioinformatics. 2023 Jul 18;24(1):285. doi: 10.1186/s12859-023-05409-7.
10
Pact-Net: Parallel CNNs and Transformers for medical image segmentation.Pact-Net:用于医学图像分割的并行卷积神经网络和Transformer
Comput Methods Programs Biomed. 2023 Dec;242:107782. doi: 10.1016/j.cmpb.2023.107782. Epub 2023 Sep 1.

引用本文的文献

1
LIT-Unet: a lightweight and effective model for medical image segmentation.LIT-Unet:一种用于医学图像分割的轻量级且有效的模型。
Radiol Phys Technol. 2024 Dec;17(4):878-887. doi: 10.1007/s12194-024-00844-4. Epub 2024 Sep 20.
2
Novel immune cross-talk between inflammatory bowel disease and IgA nephropathy.炎症性肠病与 IgA 肾病之间新型免疫交叉对话。
Ren Fail. 2024 Dec;46(1):2337288. doi: 10.1080/0886022X.2024.2337288. Epub 2024 Apr 17.
3
A Semantic Segmentation Method Based on AS-Unet++ for Power Remote Sensing of Images.

本文引用的文献

1
RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans.RA-UNet:一种用于在CT扫描中提取肝脏和肿瘤的混合深度注意力感知网络。
Front Bioeng Biotechnol. 2020 Dec 23;8:605132. doi: 10.3389/fbioe.2020.605132. eCollection 2020.
2
UNet++: A Nested U-Net Architecture for Medical Image Segmentation.U-Net++:一种用于医学图像分割的嵌套U-Net架构。
Deep Learn Med Image Anal Multimodal Learn Clin Decis Support (2018). 2018 Sep;11045:3-11. doi: 10.1007/978-3-030-00889-5_1. Epub 2018 Sep 20.
3
CE-Net: Context Encoder Network for 2D Medical Image Segmentation.
一种基于AS-Unet++的电力遥感图像语义分割方法。
Sensors (Basel). 2024 Jan 2;24(1):269. doi: 10.3390/s24010269.
4
An Improved BM3D Algorithm Based on Image Depth Feature Map and Structural Similarity Block-Matching.一种基于图像深度特征图和结构相似性块匹配的改进型BM3D算法
Sensors (Basel). 2023 Aug 18;23(16):7265. doi: 10.3390/s23167265.
CE-Net:用于二维医学图像分割的上下文编码器网络。
IEEE Trans Med Imaging. 2019 Oct;38(10):2281-2292. doi: 10.1109/TMI.2019.2903562. Epub 2019 Mar 7.
4
Attention gated networks: Learning to leverage salient regions in medical images.注意门控网络:学习利用医学图像中的显著区域。
Med Image Anal. 2019 Apr;53:197-207. doi: 10.1016/j.media.2019.01.012. Epub 2019 Feb 5.
5
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes.H-DenseUNet:用于 CT 容积的肝脏和肿瘤分割的混合密集连接 UNet。
IEEE Trans Med Imaging. 2018 Dec;37(12):2663-2674. doi: 10.1109/TMI.2018.2845918. Epub 2018 Jun 11.
6
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs.DeepLab:基于深度卷积网络、空洞卷积和全连接条件随机场的语义图像分割。
IEEE Trans Pattern Anal Mach Intell. 2018 Apr;40(4):834-848. doi: 10.1109/TPAMI.2017.2699184. Epub 2017 Apr 27.