Department of Dermatology, Huashan Hospital, Fudan University, Shanghai, China.
Academy of Engineering and Technology, Fudan University, Shanghai, China.
Am J Pathol. 2023 Jun;193(6):769-777. doi: 10.1016/j.ajpath.2023.02.008. Epub 2023 Mar 2.
Neurofibromas (NFs), Bowen disease (BD), and seborrheic keratosis (SK) are common skin tumors. Pathologic examination is the gold standard for diagnosis of these tumors. Current pathologic diagnosis is primarily based on microscopic observation, which is laborious and time-consuming. With digitization, artificial intelligence can be used to improve the efficiency of pathologic diagnosis. This research aims to develop an end-to-end extendable framework for the diagnosis of skin tumor based on pathologic slide images. NF, BD, and SK were selected as target skin tumors. A two-stage skin cancer diagnosis framework is proposed in this article, which consists of two parts: patches-wise diagnosis, and slide-wise diagnosis. Patches-wise diagnosis compares different convolutional neural networks to extract features and distinguish categories from patches generated in whole slide images. Slide-wise diagnosis combines attention graph gated network model prediction with post-processing algorithm. This approach can fuse information from feature-embedding learning and domain knowledge to draw conclusions. Training, validation, and testing were performed on NF, BD, SK, and negative samples. Accuracy and receiver operating characteristic curves were used to evaluate the classification performance. This study investigated the feasibility of skin tumor diagnosis from pathologic images and may be the first instance of applying deep learning to address these three types of tumor diagnoses in skin pathology.
神经纤维瘤(NFs)、 Bowen 病(BD)和脂溢性角化病(SK)是常见的皮肤肿瘤。病理检查是这些肿瘤诊断的金标准。目前的病理诊断主要基于显微镜观察,既繁琐又耗时。随着数字化,人工智能可以用于提高病理诊断的效率。本研究旨在开发一种基于病理切片图像的端到端可扩展的皮肤肿瘤诊断框架。NF、BD 和 SK 被选为目标皮肤肿瘤。本文提出了一种两阶段皮肤癌诊断框架,包括两部分:斑块诊断和切片诊断。斑块诊断比较了不同的卷积神经网络,以从全切片图像生成的斑块中提取特征并区分类别。切片诊断结合了注意力图门控网络模型预测和后处理算法。这种方法可以融合特征嵌入学习和领域知识的信息来得出结论。在 NF、BD、SK 和阴性样本上进行了训练、验证和测试。使用准确率和接收者操作特征曲线来评估分类性能。本研究探讨了从病理图像诊断皮肤肿瘤的可行性,这可能是首次应用深度学习来解决皮肤病理学中这三种肿瘤的诊断问题。