Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany.
Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany.
Am J Pathol. 2023 Jan;193(1):73-83. doi: 10.1016/j.ajpath.2022.09.011. Epub 2022 Oct 26.
Convolutional neural network (CNN)-based image analysis applications in digital pathology (eg, tissue segmentation) require a large amount of annotated data and are mostly trained and applicable on a single stain. Here, a novel concept based on stain augmentation is proposed to develop stain-independent CNNs requiring only one annotated stain. In this benchmark study on stain independence in digital pathology, this approach is comprehensively compared with state-of-the-art techniques including image registration and stain translation, and several modifications thereof. A previously developed CNN for segmentation of periodic acid-Schiff-stained kidney histology was used and applied to various immunohistochemical stainings. Stain augmentation showed very high performance in all evaluated stains and outperformed all other techniques in all structures and stains. Without the need for additional annotations, it enabled segmentation on immunohistochemical stainings with performance nearly comparable to that of the annotated periodic acid-Schiff stain and could further uphold performance on several held-out stains not seen during training. Herein, examples of how this framework can be applied for compartment-specific quantification of immunohistochemical stains for inflammation and fibrosis in animal models and patient biopsy specimens are presented. The results show that stain augmentation is a highly effective approach to enable stain-independent applications of deep-learning segmentation algorithms. This opens new possibilities for broad implementation in digital pathology.
基于卷积神经网络(CNN)的数字病理学图像分析应用(例如组织分割)需要大量带注释的数据,并且主要在单一染色的基础上进行训练和应用。在这里,提出了一种基于染色增强的新概念,以开发仅需要一种带注释染色的独立于染色的 CNN。在这项数字病理学染色独立性的基准研究中,该方法与包括图像配准和染色转换在内的最先进技术以及它们的几个修改版本进行了全面比较。该方法使用了之前开发的用于周期性酸-Schiff 染色肾脏组织学分割的 CNN,并将其应用于各种免疫组织化学染色。染色增强在所有评估的染色中均表现出非常高的性能,在所有结构和染色中均优于所有其他技术。无需额外的注释,它就可以实现对免疫组织化学染色的分割,其性能几乎可与带注释的过碘酸-Schiff 染色相媲美,并且可以在训练过程中未见到的几个保留染色上保持性能。本文展示了如何将该框架应用于动物模型和患者活检标本中炎症和纤维化的免疫组织化学染色的特定部位定量。结果表明,染色增强是一种非常有效的方法,可以实现深度学习分割算法的独立于染色的应用。这为数字病理学的广泛应用开辟了新的可能性。