• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

CTH-Net:一种用于皮肤病变分割的卷积神经网络与Transformer混合网络。

CTH-Net: A CNN and Transformer hybrid network for skin lesion segmentation.

作者信息

Ding Yuhan, Yi Zhenglin, Xiao Jiatong, Hu Minghui, Guo Yu, Liao Zhifang, Wang Yongjie

机构信息

School of Computer Science and Engineering, Central South University, Changsha 410083, China.

Departments of Urology, Xiangya Hospital, Central South University, Changsha 410008, China.

出版信息

iScience. 2024 Mar 6;27(4):109442. doi: 10.1016/j.isci.2024.109442. eCollection 2024 Apr 19.

DOI:10.1016/j.isci.2024.109442
PMID:38523786
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10957498/
Abstract

Automatically and accurately segmenting skin lesions can be challenging, due to factors such as low contrast and fuzzy boundaries. This paper proposes a hybrid encoder-decoder model (CTH-Net) based on convolutional neural network (CNN) and Transformer, capitalizing on the advantages of these approaches. We propose three modules for skin lesion segmentation and seamlessly connect them with carefully designed model architecture. Better segmentation performance is achieved by introducing SoftPool in the CNN branch and sandglass block in the bottleneck layer. Extensive experiments were conducted on four publicly accessible skin lesion datasets, ISIC 2016, ISIC 2017, ISIC 2018, and PH to confirm the efficacy and benefits of the proposed strategy. Experimental results show that the proposed CTH-Net provides better skin lesion segmentation performance in both quantitative and qualitative testing when compared with state-of-the-art approaches. We believe the CTH-Net design is inspiring and can be extended to other applications/frameworks.

摘要

由于对比度低和边界模糊等因素,自动且准确地分割皮肤病变可能具有挑战性。本文提出了一种基于卷积神经网络(CNN)和Transformer的混合编码器-解码器模型(CTH-Net),利用这些方法的优势。我们提出了三个用于皮肤病变分割的模块,并将它们与精心设计的模型架构无缝连接。通过在CNN分支中引入SoftPool和在瓶颈层中引入沙漏块,实现了更好的分割性能。在四个可公开访问的皮肤病变数据集ISIC 2016、ISIC 2017、ISIC 2018和PH上进行了广泛的实验,以证实所提出策略的有效性和优势。实验结果表明,与现有最先进的方法相比,所提出的CTH-Net在定量和定性测试中都提供了更好的皮肤病变分割性能。我们相信CTH-Net的设计具有启发性,并且可以扩展到其他应用/框架。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/f94f6221f5af/gr15.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/d4a6332e897f/fx1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/fa313113552f/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/3841054afe5f/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/1a75eaba3aab/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/ac6a3b042535/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/31b790066266/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/5bc9bed5af66/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/34c96f758786/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/877917f02dd8/gr8.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/396d6c6f4cc3/gr9.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/10a57d16087c/gr10.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/4f6682c6dbae/gr11.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/742254ca1677/gr12.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/26f9383bb41c/gr13.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/9f57aa271a7f/gr14.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/f94f6221f5af/gr15.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/d4a6332e897f/fx1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/fa313113552f/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/3841054afe5f/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/1a75eaba3aab/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/ac6a3b042535/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/31b790066266/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/5bc9bed5af66/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/34c96f758786/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/877917f02dd8/gr8.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/396d6c6f4cc3/gr9.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/10a57d16087c/gr10.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/4f6682c6dbae/gr11.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/742254ca1677/gr12.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/26f9383bb41c/gr13.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/9f57aa271a7f/gr14.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8325/10957498/f94f6221f5af/gr15.jpg

相似文献

1
CTH-Net: A CNN and Transformer hybrid network for skin lesion segmentation.CTH-Net:一种用于皮肤病变分割的卷积神经网络与Transformer混合网络。
iScience. 2024 Mar 6;27(4):109442. doi: 10.1016/j.isci.2024.109442. eCollection 2024 Apr 19.
2
ETU-Net: edge enhancement-guided U-Net with transformer for skin lesion segmentation.ETU-Net:基于边缘增强引导的 U-Net 与 Transformer 的皮肤病变分割。
Phys Med Biol. 2023 Dec 22;69(1). doi: 10.1088/1361-6560/ad13d2.
3
SUTrans-NET: a hybrid transformer approach to skin lesion segmentation.SUTrans-NET:一种用于皮肤病变分割的混合变压器方法。
PeerJ Comput Sci. 2024 Mar 13;10:e1935. doi: 10.7717/peerj-cs.1935. eCollection 2024.
4
Enhancing skin lesion segmentation with a fusion of convolutional neural networks and transformer models.通过融合卷积神经网络和Transformer模型增强皮肤病变分割
Heliyon. 2024 May 17;10(10):e31395. doi: 10.1016/j.heliyon.2024.e31395. eCollection 2024 May 30.
5
FAT-Net: Feature adaptive transformers for automated skin lesion segmentation.FAT-Net:用于自动皮肤病变分割的特征自适应转换器。
Med Image Anal. 2022 Feb;76:102327. doi: 10.1016/j.media.2021.102327. Epub 2021 Dec 4.
6
Dynamically aggregating MLPs and CNNs for skin lesion segmentation with geometry regularization.基于几何正则化的动态聚合 MLP 和 CNN 进行皮肤病变分割。
Comput Methods Programs Biomed. 2023 Aug;238:107601. doi: 10.1016/j.cmpb.2023.107601. Epub 2023 May 14.
7
O-Net: A Novel Framework With Deep Fusion of CNN and Transformer for Simultaneous Segmentation and Classification.O-Net:一种将卷积神经网络(CNN)与Transformer深度融合以实现同步分割和分类的新型框架。
Front Neurosci. 2022 Jun 2;16:876065. doi: 10.3389/fnins.2022.876065. eCollection 2022.
8
Transformer guided self-adaptive network for multi-scale skin lesion image segmentation.Transformer 引导的自适网络用于多尺度皮肤病变图像分割。
Comput Biol Med. 2024 Feb;169:107846. doi: 10.1016/j.compbiomed.2023.107846. Epub 2023 Dec 23.
9
EA-Net: Research on skin lesion segmentation method based on U-Net.EA-Net:基于U-Net的皮肤病变分割方法研究
Heliyon. 2023 Nov 22;9(12):e22663. doi: 10.1016/j.heliyon.2023.e22663. eCollection 2023 Dec.
10
Hybrid CNN-Transformer Network With Circular Feature Interaction for Acute Ischemic Stroke Lesion Segmentation on Non-Contrast CT Scans.基于循环特征交互的混合 CNN-Transformer 网络的非对比 CT 扫描急性缺血性脑卒中病灶分割。
IEEE Trans Med Imaging. 2024 Jun;43(6):2303-2316. doi: 10.1109/TMI.2024.3362879. Epub 2024 Jun 3.

引用本文的文献

1
A mixed Mamba U-net for prostate segmentation in MR images.混合曼巴 U 型网络在磁共振图像中前列腺分割。
Sci Rep. 2024 Aug 28;14(1):19976. doi: 10.1038/s41598-024-71045-7.

本文引用的文献

1
HI-MViT: A lightweight model for explainable skin disease classification based on modified MobileViT.HI-MViT:一种基于改进的MobileViT的用于可解释皮肤病分类的轻量级模型。
Digit Health. 2023 Oct 12;9:20552076231207197. doi: 10.1177/20552076231207197. eCollection 2023 Jan-Dec.
2
Generative AI for brain image computing and brain network computing: a review.用于脑图像计算和脑网络计算的生成式人工智能:综述
Front Neurosci. 2023 Jun 13;17:1203104. doi: 10.3389/fnins.2023.1203104. eCollection 2023.
3
MISSFormer: An Effective Transformer for 2D Medical Image Segmentation.
MISSFormer:用于二维医学图像分割的有效 Transformer。
IEEE Trans Med Imaging. 2023 May;42(5):1484-1494. doi: 10.1109/TMI.2022.3230943. Epub 2023 May 2.
4
NCRNet: Neighborhood Context Refinement Network for skin lesion segmentation.NCRNet:用于皮肤病变分割的邻域上下文细化网络。
Comput Biol Med. 2022 Jul;146:105545. doi: 10.1016/j.compbiomed.2022.105545. Epub 2022 Apr 20.
5
ICL-Net: Global and Local Inter-Pixel Correlations Learning Network for Skin Lesion Segmentation.ICL-Net:用于皮肤病变分割的全局和局部像素间相关性学习网络。
IEEE J Biomed Health Inform. 2023 Jan;27(1):145-156. doi: 10.1109/JBHI.2022.3162342. Epub 2023 Jan 4.
6
FAT-Net: Feature adaptive transformers for automated skin lesion segmentation.FAT-Net:用于自动皮肤病变分割的特征自适应转换器。
Med Image Anal. 2022 Feb;76:102327. doi: 10.1016/j.media.2021.102327. Epub 2021 Dec 4.
7
Ms RED: A novel multi-scale residual encoding and decoding network for skin lesion segmentation.雷德女士:一种用于皮肤病变分割的新型多尺度残差编码和解码网络。
Med Image Anal. 2022 Jan;75:102293. doi: 10.1016/j.media.2021.102293. Epub 2021 Nov 3.
8
HF-UNet: Learning Hierarchically Inter-Task Relevance in Multi-Task U-Net for Accurate Prostate Segmentation in CT Images.HF-UNet:在 CT 图像中进行准确前列腺分割的多任务 U-Net 中学习层次化的任务间相关性
IEEE Trans Med Imaging. 2021 Aug;40(8):2118-2128. doi: 10.1109/TMI.2021.3072956. Epub 2021 Jul 30.
9
nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation.nnU-Net:一种基于深度学习的生物医学图像分割的自配置方法。
Nat Methods. 2021 Feb;18(2):203-211. doi: 10.1038/s41592-020-01008-z. Epub 2020 Dec 7.
10
The effects of skin lesion segmentation on the performance of dermatoscopic image classification.皮肤病变分割对皮肤镜图像分类性能的影响。
Comput Methods Programs Biomed. 2020 Dec;197:105725. doi: 10.1016/j.cmpb.2020.105725. Epub 2020 Aug 26.