• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

在皮肤癌图像中使用具有双向注意力机制的可变形注意力Transformer U-Net进行智能皮肤病变分割。

Intelligent skin lesion segmentation using deformable attention Transformer U-Net with bidirectional attention mechanism in skin cancer images.

作者信息

Cai Lili, Hou Keke, Zhou Su

机构信息

School of Biomedical Engineering, Guangzhou Xinhua University, Guangzhou, China.

School of Health Sciences, Guangzhou Xinhua University, Guangzhou, China.

出版信息

Skin Res Technol. 2024 Aug;30(8):e13783. doi: 10.1111/srt.13783.

DOI:10.1111/srt.13783
PMID:39113617
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11306920/
Abstract

BACKGROUND

In recent years, the increasing prevalence of skin cancers, particularly malignant melanoma, has become a major concern for public health. The development of accurate automated segmentation techniques for skin lesions holds immense potential in alleviating the burden on medical professionals. It is of substantial clinical importance for the early identification and intervention of skin cancer. Nevertheless, the irregular shape, uneven color, and noise interference of the skin lesions have presented significant challenges to the precise segmentation. Therefore, it is crucial to develop a high-precision and intelligent skin lesion segmentation framework for clinical treatment.

METHODS

A precision-driven segmentation model for skin cancer images is proposed based on the Transformer U-Net, called BiADATU-Net, which integrates the deformable attention Transformer and bidirectional attention blocks into the U-Net. The encoder part utilizes deformable attention Transformer with dual attention block, allowing adaptive learning of global and local features. The decoder part incorporates specifically tailored scSE attention modules within skip connection layers to capture image-specific context information for strong feature fusion. Additionally, deformable convolution is aggregated into two different attention blocks to learn irregular lesion features for high-precision prediction.

RESULTS

A series of experiments are conducted on four skin cancer image datasets (i.e., ISIC2016, ISIC2017, ISIC2018, and PH2). The findings show that our model exhibits satisfactory segmentation performance, all achieving an accuracy rate of over 96%.

CONCLUSION

Our experiment results validate the proposed BiADATU-Net achieves competitive performance supremacy compared to some state-of-the-art methods. It is potential and valuable in the field of skin lesion segmentation.

摘要

背景

近年来,皮肤癌,尤其是恶性黑色素瘤的发病率不断上升,已成为公共卫生领域的一个主要关注点。开发用于皮肤病变的精确自动分割技术在减轻医学专业人员的负担方面具有巨大潜力。这对于皮肤癌的早期识别和干预具有重要的临床意义。然而,皮肤病变的形状不规则、颜色不均匀以及噪声干扰对精确分割提出了重大挑战。因此,开发一个用于临床治疗的高精度智能皮肤病变分割框架至关重要。

方法

基于Transformer U-Net提出了一种用于皮肤癌图像的精度驱动分割模型,称为BiADATU-Net,它将可变形注意力Transformer和双向注意力块集成到U-Net中。编码器部分利用带有双注意力块的可变形注意力Transformer,允许自适应学习全局和局部特征。解码器部分在跳跃连接层中并入专门定制的scSE注意力模块,以捕获特定于图像的上下文信息以进行强大的特征融合。此外,可变形卷积被聚合到两个不同的注意力块中,以学习不规则病变特征以进行高精度预测。

结果

在四个皮肤癌图像数据集(即ISIC2016、ISIC2017、ISIC2018和PH2)上进行了一系列实验。结果表明,我们的模型表现出令人满意的分割性能,所有准确率均超过96%。

结论

我们的实验结果验证了所提出的BiADATU-Net与一些现有最先进方法相比具有具有竞争力的性能优势。它在皮肤病变分割领域具有潜力和价值。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/f7d683bc5297/SRT-30-e13783-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/d536c74715d4/SRT-30-e13783-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/fdbf0936cc49/SRT-30-e13783-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/06c2e0d85ac4/SRT-30-e13783-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/17888ddeaf41/SRT-30-e13783-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/17861815f39c/SRT-30-e13783-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/9a91dfdb7cfc/SRT-30-e13783-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/475955f0f670/SRT-30-e13783-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/0d642a64e79e/SRT-30-e13783-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/f7d683bc5297/SRT-30-e13783-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/d536c74715d4/SRT-30-e13783-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/fdbf0936cc49/SRT-30-e13783-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/06c2e0d85ac4/SRT-30-e13783-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/17888ddeaf41/SRT-30-e13783-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/17861815f39c/SRT-30-e13783-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/9a91dfdb7cfc/SRT-30-e13783-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/475955f0f670/SRT-30-e13783-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/0d642a64e79e/SRT-30-e13783-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a43d/11306920/f7d683bc5297/SRT-30-e13783-g007.jpg

相似文献

1
Intelligent skin lesion segmentation using deformable attention Transformer U-Net with bidirectional attention mechanism in skin cancer images.在皮肤癌图像中使用具有双向注意力机制的可变形注意力Transformer U-Net进行智能皮肤病变分割。
Skin Res Technol. 2024 Aug;30(8):e13783. doi: 10.1111/srt.13783.
2
HMA-Net: A deep U-shaped network combined with HarDNet and multi-attention mechanism for medical image segmentation.HMA-Net:一种结合 HarDNet 和多注意力机制的深度 U 形网络,用于医学图像分割。
Med Phys. 2023 Mar;50(3):1635-1646. doi: 10.1002/mp.16065. Epub 2022 Nov 3.
3
MASDF-Net: A Multi-Attention Codec Network with Selective and Dynamic Fusion for Skin Lesion Segmentation.MASDF-Net:一种具有选择性和动态融合的多注意编解码器网络,用于皮肤病变分割。
Sensors (Basel). 2024 Aug 20;24(16):5372. doi: 10.3390/s24165372.
4
Segmentation of dermoscopy images based on deformable 3D convolution and ResU-NeXt +.基于可变形 3D 卷积和 ResU-NeXt+的皮肤镜图像分割。
Med Biol Eng Comput. 2021 Sep;59(9):1815-1832. doi: 10.1007/s11517-021-02397-9. Epub 2021 Jul 24.
5
Dynamically aggregating MLPs and CNNs for skin lesion segmentation with geometry regularization.基于几何正则化的动态聚合 MLP 和 CNN 进行皮肤病变分割。
Comput Methods Programs Biomed. 2023 Aug;238:107601. doi: 10.1016/j.cmpb.2023.107601. Epub 2023 May 14.
6
ETU-Net: edge enhancement-guided U-Net with transformer for skin lesion segmentation.ETU-Net:基于边缘增强引导的 U-Net 与 Transformer 的皮肤病变分割。
Phys Med Biol. 2023 Dec 22;69(1). doi: 10.1088/1361-6560/ad13d2.
7
Enhancing skin lesion segmentation with a fusion of convolutional neural networks and transformer models.通过融合卷积神经网络和Transformer模型增强皮肤病变分割
Heliyon. 2024 May 17;10(10):e31395. doi: 10.1016/j.heliyon.2024.e31395. eCollection 2024 May 30.
8
Transformer guided self-adaptive network for multi-scale skin lesion image segmentation.Transformer 引导的自适网络用于多尺度皮肤病变图像分割。
Comput Biol Med. 2024 Feb;169:107846. doi: 10.1016/j.compbiomed.2023.107846. Epub 2023 Dec 23.
9
Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review.深度学习方法在皮肤镜图像的皮肤损伤分割和分类中的应用综述。
Curr Med Imaging. 2020;16(5):513-533. doi: 10.2174/1573405615666190129120449.
10
MADR-Net: multi-level attention dilated residual neural network for segmentation of medical images.MADR-Net:用于医学图像分割的多层次注意扩张残差神经网络。
Sci Rep. 2024 Jun 3;14(1):12699. doi: 10.1038/s41598-024-63538-2.

本文引用的文献

1
DA-TransUNet: integrating spatial and channel dual attention with transformer U-net for medical image segmentation.DA-TransUNet:将空间和通道双重注意力与Transformer U-Net相结合用于医学图像分割
Front Bioeng Biotechnol. 2024 May 16;12:1398237. doi: 10.3389/fbioe.2024.1398237. eCollection 2024.
2
Segmentation and classification of skin lesions using hybrid deep learning method in the Internet of Medical Things.基于物联网的混合深度学习方法对皮肤损伤的分割与分类
Skin Res Technol. 2023 Nov;29(11):e13524. doi: 10.1111/srt.13524.
3
Attention-based dual-path feature fusion network for automatic skin lesion segmentation.
用于自动皮肤病变分割的基于注意力的双路径特征融合网络。
BioData Min. 2023 Oct 9;16(1):28. doi: 10.1186/s13040-023-00345-x.
4
Dynamically aggregating MLPs and CNNs for skin lesion segmentation with geometry regularization.基于几何正则化的动态聚合 MLP 和 CNN 进行皮肤病变分割。
Comput Methods Programs Biomed. 2023 Aug;238:107601. doi: 10.1016/j.cmpb.2023.107601. Epub 2023 May 14.
5
SharpRazor: Automatic removal of hair and ruler marks from dermoscopy images.SharpRazor:自动去除皮肤镜图像中的毛发和标尺标记。
Skin Res Technol. 2023 Apr;29(4):e13203. doi: 10.1111/srt.13203.
6
Automatic lesion segmentation using atrous convolutional deep neural networks in dermoscopic skin cancer images.基于空洞卷积深度神经网络的皮肤镜图像中自动病变分割。
BMC Med Imaging. 2022 May 29;22(1):103. doi: 10.1186/s12880-022-00829-y.
7
A deep learning approach to detect blood vessels in basal cell carcinoma.深度学习在基底细胞癌血管检测中的应用
Skin Res Technol. 2022 Jul;28(4):571-576. doi: 10.1111/srt.13150. Epub 2022 May 25.
8
Skin Lesion Area Segmentation Using Attention Squeeze U-Net for Embedded Devices.基于注意力挤压 U-Net 的嵌入式设备皮肤病变区域分割。
J Digit Imaging. 2022 Oct;35(5):1217-1230. doi: 10.1007/s10278-022-00634-7. Epub 2022 May 3.
9
Global Burden of Cutaneous Melanoma in 2020 and Projections to 2040.2020 年全球皮肤黑色素瘤负担及 2040 年预测。
JAMA Dermatol. 2022 May 1;158(5):495-503. doi: 10.1001/jamadermatol.2022.0160.
10
FAT-Net: Feature adaptive transformers for automated skin lesion segmentation.FAT-Net:用于自动皮肤病变分割的特征自适应转换器。
Med Image Anal. 2022 Feb;76:102327. doi: 10.1016/j.media.2021.102327. Epub 2021 Dec 4.