• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

TransU²-Net:一种基于 Transformer 和 U²-Net 的有效医学图像分割框架。

TransU²-Net: An Effective Medical Image Segmentation Framework Based on Transformer and U²-Net.

机构信息

School of Safety Science and EngineeringAnhui University of Science and Technology Huainan 232000 China.

School of Computer Science and EngineeringAnhui University of Science and Technology Huainan 232000 China.

出版信息

IEEE J Transl Eng Health Med. 2023 Jun 27;11:441-450. doi: 10.1109/JTEHM.2023.3289990. eCollection 2023.

DOI:10.1109/JTEHM.2023.3289990
PMID:37817826
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10561737/
Abstract

BACKGROUND

In the past few years, U-Net based U-shaped architecture and skip-connections have made incredible progress in the field of medical image segmentation. U-Net achieves good performance in computer vision. However, in the medical image segmentation task, U-Net with over nesting is easy to overfit.

PURPOSE

A 2D network structure TransU-Net combining transformer and a lighter weight U-Net is proposed for automatic segmentation of brain tumor magnetic resonance image (MRI).

METHODS

The light-weight U-Net architecture not only obtains multi-scale information but also reduces redundant feature extraction. Meanwhile, the transformer block embedded in the stacked convolutional layer obtains more global information; the transformer with skip-connection enhances spatial domain information representation. A new multi-scale feature map fusion strategy as a postprocessing method was proposed for better fusing high and low-dimensional spatial information.

RESULTS

Our proposed model TransU-Net achieves better segmentation results, on the BraTS2021 dataset, our method achieves an average dice coefficient of 88.17%; Evaluation on the publicly available MSD dataset, we perform tumor evaluation, we achieve a dice coefficient of 74.69%; in addition to comparing the TransU-Net results are compared with previously proposed 2D segmentation methods.

CONCLUSIONS

We propose an automatic medical image segmentation method combining transformers and U-Net, which has good performance and is of clinical importance. The experimental results show that the proposed method outperforms other 2D medical image segmentation methods. : We use the BarTS2021 dataset and the MSD dataset which are publicly available databases. All experiments in this paper are in accordance with medical ethics.

摘要

背景

在过去的几年中,基于 U-Net 的 U 形结构和跳跃连接在医学图像分割领域取得了令人瞩目的进展。U-Net 在计算机视觉中表现出色。然而,在医学图像分割任务中,嵌套过深的 U-Net 容易过拟合。

目的

提出了一种结合 Transformer 和更轻量级的 U-Net 的 2D 网络结构 TransU-Net,用于自动分割脑肿瘤磁共振图像(MRI)。

方法

轻量级 U-Net 架构不仅可以获取多尺度信息,还可以减少冗余的特征提取。同时,嵌入堆叠卷积层中的 Transformer 块可以获取更多的全局信息;具有跳跃连接的 Transformer 可以增强空间域信息表示。提出了一种新的多尺度特征图融合策略作为后处理方法,以更好地融合高低维空间信息。

结果

我们提出的模型 TransU-Net 取得了更好的分割结果,在 BraTS2021 数据集上,我们的方法平均 Dice 系数为 88.17%;在公开的 MSD 数据集上进行肿瘤评估,我们的 Dice 系数为 74.69%;除了比较 TransU-Net 的结果外,还与之前提出的 2D 分割方法进行了比较。

结论

我们提出了一种结合 Transformer 和 U-Net 的自动医学图像分割方法,具有良好的性能,具有临床意义。实验结果表明,所提出的方法优于其他 2D 医学图像分割方法。我们使用了公开的 BraTS2021 数据集和 MSD 数据集。本文中的所有实验都符合医学伦理。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/59446c473e57/fang8-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/beb409180004/fang1-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/3fb23182c6b9/fang2-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/e2635b8e09af/fang3-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/a4f083b872cb/fang4-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/accf228681d7/fang5-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/0d827cb5be94/fang6-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/669c72aa5c7e/fang7-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/59446c473e57/fang8-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/beb409180004/fang1-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/3fb23182c6b9/fang2-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/e2635b8e09af/fang3-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/a4f083b872cb/fang4-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/accf228681d7/fang5-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/0d827cb5be94/fang6-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/669c72aa5c7e/fang7-3289990.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8761/10561737/59446c473e57/fang8-3289990.jpg

相似文献

1
TransU²-Net: An Effective Medical Image Segmentation Framework Based on Transformer and U²-Net.TransU²-Net:一种基于 Transformer 和 U²-Net 的有效医学图像分割框架。
IEEE J Transl Eng Health Med. 2023 Jun 27;11:441-450. doi: 10.1109/JTEHM.2023.3289990. eCollection 2023.
2
MESTrans: Multi-scale embedding spatial transformer for medical image segmentation.MESTrans:用于医学图像分割的多尺度嵌入空间变换器
Comput Methods Programs Biomed. 2023 May;233:107493. doi: 10.1016/j.cmpb.2023.107493. Epub 2023 Mar 17.
3
MBUTransNet: multi-branch U-shaped network fusion transformer architecture for medical image segmentation.MBUTransNet:用于医学图像分割的多分支 U 形网络融合变压器架构。
Int J Comput Assist Radiol Surg. 2023 Oct;18(10):1895-1902. doi: 10.1007/s11548-023-02879-1. Epub 2023 Apr 6.
4
Dual encoder network with transformer-CNN for multi-organ segmentation.基于 Transformer-CNN 的双编码器网络的多器官分割。
Med Biol Eng Comput. 2023 Mar;61(3):661-671. doi: 10.1007/s11517-022-02723-9. Epub 2022 Dec 29.
5
SWTRU: Star-shaped Window Transformer Reinforced U-Net for medical image segmentation.SWTRU:星型窗口变换增强 U-Net 用于医学图像分割。
Comput Biol Med. 2022 Nov;150:105954. doi: 10.1016/j.compbiomed.2022.105954. Epub 2022 Aug 13.
6
BiU-net: A dual-branch structure based on two-stage fusion strategy for biomedical image segmentation.BiU-net:一种基于两阶段融合策略的双分支结构,用于生物医学图像分割。
Comput Methods Programs Biomed. 2024 Jul;252:108235. doi: 10.1016/j.cmpb.2024.108235. Epub 2024 May 18.
7
A new architecture combining convolutional and transformer-based networks for automatic 3D multi-organ segmentation on CT images.一种新的架构,结合了卷积和基于Transformer 的网络,用于 CT 图像上的自动 3D 多器官分割。
Med Phys. 2023 Nov;50(11):6990-7002. doi: 10.1002/mp.16750. Epub 2023 Sep 22.
8
TransConver: transformer and convolution parallel network for developing automatic brain tumor segmentation in MRI images.TransConver:用于在MRI图像中开发自动脑肿瘤分割的变压器与卷积并行网络。
Quant Imaging Med Surg. 2022 Apr;12(4):2397-2415. doi: 10.21037/qims-21-919.
9
High-Resolution Swin Transformer for Automatic Medical Image Segmentation.基于高分辨率 Swin Transformer 的医学图像自动分割。
Sensors (Basel). 2023 Mar 24;23(7):3420. doi: 10.3390/s23073420.
10
MAU-Net: Mixed attention U-Net for MRI brain tumor segmentation.MAU-Net:用于 MRI 脑肿瘤分割的混合注意力 U-Net。
Math Biosci Eng. 2023 Nov 13;20(12):20510-20527. doi: 10.3934/mbe.2023907.

引用本文的文献

1
ICT-Net: An Integrated Convolution and Transformer-Based Network for Complex Liver and Liver Tumor Region Segmentation.ICT-Net:一种基于卷积与Transformer的集成网络,用于复杂肝脏及肝脏肿瘤区域分割
IEEE J Transl Eng Health Med. 2025 Jul 7;13:310-322. doi: 10.1109/JTEHM.2025.3586470. eCollection 2025.
2
A novel metastatic tumor segmentation method with a new evaluation metric in clinic study.一种在临床研究中具有新评估指标的新型转移性肿瘤分割方法。
Front Med (Lausanne). 2024 Oct 2;11:1375851. doi: 10.3389/fmed.2024.1375851. eCollection 2024.
3
Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment.

本文引用的文献

1
Coarse-to-fine multiplanar D-SEA UNet for automatic 3D carotid segmentation in CTA images.基于粗细到精细多层面 D-SEA UNet 的 CTA 图像中颈动脉自动三维分割。
Int J Comput Assist Radiol Surg. 2021 Oct;16(10):1727-1736. doi: 10.1007/s11548-021-02471-5. Epub 2021 Aug 12.
2
ITGB2 as a prognostic indicator and a predictive marker for immunotherapy in gliomas.ITGB2 作为胶质瘤免疫治疗的预后指标和预测标志物。
Cancer Immunol Immunother. 2022 Mar;71(3):645-660. doi: 10.1007/s00262-021-03022-2. Epub 2021 Jul 27.
3
CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation.
人工智能在癌症诊断和治疗中的新研究与未来展望。
J Hematol Oncol. 2023 Nov 27;16(1):114. doi: 10.1186/s13045-023-01514-5.
CA-Net:用于可解释医学图像分割的综合注意力卷积神经网络。
IEEE Trans Med Imaging. 2021 Feb;40(2):699-711. doi: 10.1109/TMI.2020.3035253. Epub 2021 Feb 2.
4
UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation.UNet++:重新设计跳过连接以利用图像分割中的多尺度特征。
IEEE Trans Med Imaging. 2020 Jun;39(6):1856-1867. doi: 10.1109/TMI.2019.2959609. Epub 2019 Dec 13.
5
Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features.利用专家分割标签和放射组学特征推进癌症基因组图谱胶质细胞瘤 MRI 数据集。
Sci Data. 2017 Sep 5;4:170117. doi: 10.1038/sdata.2017.117.
6
Improving automated multiple sclerosis lesion segmentation with a cascaded 3D convolutional neural network approach.采用级联3D卷积神经网络方法改进自动多发性硬化病变分割
Neuroimage. 2017 Jul 15;155:159-168. doi: 10.1016/j.neuroimage.2017.04.034. Epub 2017 Apr 19.
7
Visual Saliency Detection Based on Multiscale Deep CNN Features.基于多尺度深度卷积神经网络特征的显著目标检测
IEEE Trans Image Process. 2016 Nov;25(11):5012-5024. doi: 10.1109/TIP.2016.2602079. Epub 2016 Aug 24.
8
Automatic 3D liver location and segmentation via convolutional neural network and graph cut.通过卷积神经网络和图割实现肝脏的自动三维定位与分割
Int J Comput Assist Radiol Surg. 2017 Feb;12(2):171-182. doi: 10.1007/s11548-016-1467-3. Epub 2016 Sep 7.
9
Brain tumor segmentation with Deep Neural Networks.基于深度神经网络的脑肿瘤分割。
Med Image Anal. 2017 Jan;35:18-31. doi: 10.1016/j.media.2016.05.004. Epub 2016 May 19.
10
Fully Convolutional Networks for Semantic Segmentation.全卷积网络用于语义分割。
IEEE Trans Pattern Anal Mach Intell. 2017 Apr;39(4):640-651. doi: 10.1109/TPAMI.2016.2572683. Epub 2016 May 24.