Department of Bioengineering, University of Louisville, Louisville, KY, USA.
Department of Bioengineering, University of Louisville, Louisville, KY, USA.
Med Image Anal. 2022 Oct;81:102537. doi: 10.1016/j.media.2022.102537. Epub 2022 Jul 19.
Assessing the degree of liver fibrosis is fundamental for the management of patients with chronic liver disease, in liver transplants procedures, and in general liver disease research. The fibrosis stage is best assessed by histopathologic evaluation, and Masson's Trichrome stain (MT) is the stain of choice for this task in many laboratories around the world. However, the most used stain in histopathology is Hematoxylin Eosin (HE) which is cheaper, has a faster turn-around time and is the primary stain routinely used for evaluation of liver specimens. In this paper, we propose a novel digital pathology system that accurately detects and quantifies the footprint of fibrous tissue in HE whole slide images (WSI). The proposed system produces virtual MT images from HE using a deep learning model that learns deep texture patterns associated with collagen fibers. The training pipeline is based on conditional generative adversarial networks (cGAN), which can achieve accurate pixel-level transformation. Our comprehensive training pipeline features an automatic WSI registration algorithm, which qualifies the HE/MT training slides for the cGAN model. Using liver specimens collected during liver transplantation procedures, we conducted a range of experiments to evaluate the detected footprint of selected anatomical features. Our evaluation includes both image similarity and semantic segmentation metrics. The proposed system achieved enhanced results in the experiments with significant improvement over the state-of-the-art CycleGAN learning style, and over direct prediction of fibrosis in HE without having the virtual MT step.
评估肝纤维化程度对于慢性肝病患者的管理、肝移植手术以及一般的肝病研究至关重要。纤维化分期最好通过组织病理学评估来确定,而马松三色染色(MT)是全球许多实验室用于此任务的首选染色方法。然而,组织病理学中最常用的染色方法是苏木精-伊红(HE),因为它更便宜、周转时间更快,并且是常规用于评估肝标本的主要染色方法。在本文中,我们提出了一种新颖的数字病理学系统,该系统可以准确检测和量化 HE 全切片图像(WSI)中纤维组织的足迹。该系统使用深度学习模型从 HE 生成虚拟 MT 图像,该模型学习与胶原纤维相关的深层纹理模式。训练流水线基于条件生成对抗网络(cGAN),可以实现精确的像素级转换。我们全面的训练流水线具有自动 WSI 注册算法,该算法为 cGAN 模型提供了 HE/MT 训练幻灯片的资格。使用在肝移植手术中收集的肝标本,我们进行了一系列实验,以评估所选解剖特征的检测足迹。我们的评估包括图像相似性和语义分割指标。与最先进的 CycleGAN 学习风格相比,该系统在实验中取得了增强的结果,并且在没有虚拟 MT 步骤的情况下直接预测 HE 中的纤维化也有显著改善。