• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于Transformer的皮肤癌组织病理学图像多类别分割框架。

Transformer-based framework for multi-class segmentation of skin cancer from histopathology images.

作者信息

Imran Muhammad, Islam Tiwana Mohsin, Mohsan Mashood Mohammad, Alghamdi Norah Saleh, Akram Muhammad Usman

机构信息

Department of Mechatronics Engineering, National University of Sciences and Technology, Islamabad, Pakistan.

Department of Computer and Software Engineering, National University of Sciences and Technology, Islamabad, Pakistan.

出版信息

Front Med (Lausanne). 2024 Apr 29;11:1380405. doi: 10.3389/fmed.2024.1380405. eCollection 2024.

DOI:10.3389/fmed.2024.1380405
PMID:38741771
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11089103/
Abstract

INTRODUCTION

Non-melanoma skin cancer comprising Basal cell carcinoma (BCC), Squamous cell carcinoma (SCC), and Intraepidermal carcinoma (IEC) has the highest incidence rate among skin cancers. Intelligent decision support systems may address the issue of the limited number of subject experts and help in mitigating the parity of health services between urban centers and remote areas.

METHOD

In this research, we propose a transformer-based model for the segmentation of histopathology images not only into inflammation and cancers such as BCC, SCC, and IEC but also to identify skin tissues and boundaries that are important in decision-making. Accurate segmentation of these tissue types will eventually lead to accurate detection and classification of non-melanoma skin cancer. The segmentation according to tissue types and their visual representation before classification enhances the trust of pathologists and doctors being relatable to how most pathologists approach this problem. The visualization of the confidence of the model in its prediction through uncertainty maps is also what distinguishes this study from most deep learning methods.

RESULTS

The evaluation of proposed system is carried out using publicly available dataset. The application of our proposed segmentation system demonstrated good performance with an F1 score of 0.908, mean intersection over union (mIoU) of 0.653, and average accuracy of 83.1%, advocating that the system can be used as a decision support system successfully and has the potential of subsequently maturing into a fully automated system.

DISCUSSION

This study is an attempt to automate the segmentation of the most occurring non-melanoma skin cancer using a transformer-based deep learning technique applied to histopathology skin images. Highly accurate segmentation and visual representation of histopathology images according to tissue types by the proposed system implies that the system can be used for skin-related routine pathology tasks including cancer and other anomaly detection, their classification, and measurement of surgical margins in the case of cancer cases.

摘要

引言

非黑色素瘤皮肤癌包括基底细胞癌(BCC)、鳞状细胞癌(SCC)和表皮内癌(IEC),在皮肤癌中发病率最高。智能决策支持系统可以解决主题专家数量有限的问题,并有助于缓解城市中心和偏远地区医疗服务的差距。

方法

在本研究中,我们提出了一种基于Transformer的模型,用于对组织病理学图像进行分割,不仅可以将其分为炎症和癌症(如BCC、SCC和IEC),还可以识别在决策中重要的皮肤组织和边界。这些组织类型的准确分割最终将导致非黑色素瘤皮肤癌的准确检测和分类。在分类之前根据组织类型及其视觉表示进行分割,增强了病理学家和医生对其的信任,因为这与大多数病理学家处理该问题的方式相关。通过不确定性图可视化模型预测的置信度也是本研究与大多数深度学习方法的区别所在。

结果

使用公开可用数据集对所提出的系统进行评估。我们提出的分割系统的应用表现良好,F1分数为0.908,平均交并比(mIoU)为0.653,平均准确率为83.1%,表明该系统可以成功用作决策支持系统,并有可能随后成熟为一个全自动系统。

讨论

本研究试图使用应用于组织病理学皮肤图像的基于Transformer的深度学习技术,实现最常见的非黑色素瘤皮肤癌分割的自动化。所提出的系统根据组织类型对组织病理学图像进行高度准确的分割和视觉表示,这意味着该系统可用于与皮肤相关的常规病理学任务,包括癌症和其他异常检测、它们的分类,以及在癌症病例中测量手术切缘。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/bbe23650d50c/fmed-11-1380405-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/e37ea8dd2446/fmed-11-1380405-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/af5d0e5131a0/fmed-11-1380405-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/53208cf07c67/fmed-11-1380405-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/6f2145e6d150/fmed-11-1380405-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/bbe23650d50c/fmed-11-1380405-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/e37ea8dd2446/fmed-11-1380405-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/af5d0e5131a0/fmed-11-1380405-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/53208cf07c67/fmed-11-1380405-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/6f2145e6d150/fmed-11-1380405-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cda0/11089103/bbe23650d50c/fmed-11-1380405-g0005.jpg

相似文献

1
Transformer-based framework for multi-class segmentation of skin cancer from histopathology images.基于Transformer的皮肤癌组织病理学图像多类别分割框架。
Front Med (Lausanne). 2024 Apr 29;11:1380405. doi: 10.3389/fmed.2024.1380405. eCollection 2024.
2
Recognizing basal cell carcinoma on smartphone-captured digital histopathology images with a deep neural network.利用深度神经网络在智能手机拍摄的数字组织病理学图像上识别基底细胞癌。
Br J Dermatol. 2020 Mar;182(3):754-762. doi: 10.1111/bjd.18026. Epub 2019 Aug 22.
3
Nuclei instance segmentation from histopathology images using Bayesian dropout based deep learning.基于贝叶斯随机失活的深度学习方法进行组织病理学图像细胞核实例分割。
BMC Med Imaging. 2023 Oct 19;23(1):162. doi: 10.1186/s12880-023-01121-3.
4
Non-melanoma skin cancer segmentation for histopathology dataset.用于组织病理学数据集的非黑色素瘤皮肤癌分割
Data Brief. 2021 Nov 19;39:107587. doi: 10.1016/j.dib.2021.107587. eCollection 2021 Dec.
5
Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features.通过深度卷积激活特征进行大规模组织病理图像分类、分割和可视化
BMC Bioinformatics. 2017 May 26;18(1):281. doi: 10.1186/s12859-017-1685-x.
6
Deep learning-based semantic segmentation of non-melanocytic skin tumors in whole-slide histopathological images.基于深度学习的全切片组织病理图像中非黑色素性皮肤肿瘤的语义分割。
Exp Dermatol. 2023 Jun;32(6):831-839. doi: 10.1111/exd.14782. Epub 2023 Apr 5.
7
Transformer guided self-adaptive network for multi-scale skin lesion image segmentation.Transformer 引导的自适网络用于多尺度皮肤病变图像分割。
Comput Biol Med. 2024 Feb;169:107846. doi: 10.1016/j.compbiomed.2023.107846. Epub 2023 Dec 23.
8
Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review.深度学习方法在皮肤镜图像的皮肤损伤分割和分类中的应用综述。
Curr Med Imaging. 2020;16(5):513-533. doi: 10.2174/1573405615666190129120449.
9
LiverNet: efficient and robust deep learning model for automatic diagnosis of sub-types of liver hepatocellular carcinoma cancer from H&E stained liver histopathology images.LiverNet:一种高效、稳健的深度学习模型,用于从 H&E 染色的肝脏组织病理学图像中自动诊断肝肝细胞癌亚型。
Int J Comput Assist Radiol Surg. 2021 Sep;16(9):1549-1563. doi: 10.1007/s11548-021-02410-4. Epub 2021 May 30.
10
A deep learning-based framework (Co-ReTr) for auto-segmentation of non-small cell-lung cancer in computed tomography images.一种基于深度学习的框架(Co-ReTr),用于在计算机断层扫描图像中对非小细胞肺癌进行自动分割。
J Appl Clin Med Phys. 2024 Mar;25(3):e14297. doi: 10.1002/acm2.14297. Epub 2024 Feb 19.

引用本文的文献

1
Hematoxylin and Eosin-stained whole slide image dataset annotated for skin tissue segmentation.用于皮肤组织分割的苏木精和伊红染色全玻片图像数据集,已进行标注。
Data Brief. 2025 Jan 14;59:111306. doi: 10.1016/j.dib.2025.111306. eCollection 2025 Apr.

本文引用的文献

1
A methodical exploration of imaging modalities from dataset to detection through machine learning paradigms in prominent lung disease diagnosis: a review.通过机器学习范式对影像模态进行系统探索,从数据集到检测,以诊断显著肺部疾病:综述。
BMC Med Imaging. 2024 Feb 1;24(1):30. doi: 10.1186/s12880-024-01192-w.
2
The use of artificial intelligence tools in cancer detection compared to the traditional diagnostic imaging methods: An overview of the systematic reviews.人工智能工具在癌症检测中的应用与传统诊断成像方法的比较:系统评价综述。
PLoS One. 2023 Oct 5;18(10):e0292063. doi: 10.1371/journal.pone.0292063. eCollection 2023.
3
Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.
停止为高风险决策解释黑箱机器学习模型,转而使用可解释模型。
Nat Mach Intell. 2019 May;1(5):206-215. doi: 10.1038/s42256-019-0048-x. Epub 2019 May 13.
4
Cancer Incidence, Mortality, Years of Life Lost, Years Lived With Disability, and Disability-Adjusted Life Years for 29 Cancer Groups From 2010 to 2019: A Systematic Analysis for the Global Burden of Disease Study 2019.2010 年至 2019 年 29 种癌症的发病率、死亡率、生命损失年数、失能生存年数和伤残调整生命年:2019 年全球疾病负担研究的系统分析。
JAMA Oncol. 2022 Mar 1;8(3):420-444. doi: 10.1001/jamaoncol.2021.6987.
5
Non-melanoma skin cancer segmentation for histopathology dataset.用于组织病理学数据集的非黑色素瘤皮肤癌分割
Data Brief. 2021 Nov 19;39:107587. doi: 10.1016/j.dib.2021.107587. eCollection 2021 Dec.
6
AI outperformed every dermatologist in dermoscopic melanoma diagnosis, using an optimized deep-CNN architecture with custom mini-batch logic and loss function.AI 在皮肤科黑色素瘤诊断方面的表现优于每位皮肤科医生,它使用了经过优化的深度卷积神经网络架构,具有自定义的小批量逻辑和损失函数。
Sci Rep. 2021 Sep 1;11(1):17485. doi: 10.1038/s41598-021-96707-8.
7
AI in medicine must be explainable.医学中的人工智能必须是可解释的。
Nat Med. 2021 Aug;27(8):1328. doi: 10.1038/s41591-021-01461-z.
8
United States burden of melanoma and non-melanoma skin cancer from 1990 to 2019.美国 1990 年至 2019 年黑色素瘤和非黑色素瘤皮肤癌负担。
J Am Acad Dermatol. 2021 Aug;85(2):388-395. doi: 10.1016/j.jaad.2021.03.109. Epub 2021 Apr 20.
9
Human-interpretable image features derived from densely mapped cancer pathology slides predict diverse molecular phenotypes.从密集绘制的癌症病理学幻灯片中提取的可解释的图像特征可预测多种分子表型。
Nat Commun. 2021 Mar 12;12(1):1613. doi: 10.1038/s41467-021-21896-9.
10
A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19).利用 CT 图像进行冠状病毒病(COVID-19)筛查的深度学习算法。
Eur Radiol. 2021 Aug;31(8):6096-6104. doi: 10.1007/s00330-021-07715-1. Epub 2021 Feb 24.