Department of Chemical and Biomolecular Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois; Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois.
Department of Medicine, University of California San Diego, San Diego, California.
Lab Invest. 2023 Jan;103(1):100006. doi: 10.1016/j.labinv.2022.100006.
A pathologist's optical microscopic examination of thinly cut, stained tissue on glass slides prepared from a formalin-fixed paraffin-embedded tissue blocks is the gold standard for tissue diagnostics. In addition, the diagnostic abilities and expertise of pathologists is dependent on their direct experience with common and rarer variant morphologies. Recently, deep learning approaches have been used to successfully show a high level of accuracy for such tasks. However, obtaining expert-level annotated images is an expensive and time-consuming task, and artificially synthesized histologic images can prove greatly beneficial. In this study, we present an approach to not only generate histologic images that reproduce the diagnostic morphologic features of common disease but also provide a user ability to generate new and rare morphologies. Our approach involves developing a generative adversarial network model that synthesizes pathology images constrained by class labels. We investigated the ability of this framework in synthesizing realistic prostate and colon tissue images and assessed the utility of these images in augmenting the diagnostic ability of machine learning methods and their usability by a panel of experienced anatomic pathologists. Synthetic data generated by our framework performed similar to real data when training a deep learning model for diagnosis. Pathologists were not able to distinguish between real and synthetic images, and their analyses showed a similar level of interobserver agreement for prostate cancer grading. We extended the approach to significantly more complex images from colon biopsies and showed that the morphology of the complex microenvironment in such tissues can be reproduced. Finally, we present the ability for a user to generate deepfake histologic images using a simple markup of sematic labels.
病理学家通过对从福尔马林固定石蜡包埋组织块制备的载玻片上的薄切片、染色组织进行光学显微镜检查,这是组织诊断的金标准。此外,病理学家的诊断能力和专业知识取决于他们对常见和罕见变异形态的直接经验。最近,深度学习方法已成功地证明了此类任务的高度准确性。然而,获得专家级注释图像是一项昂贵且耗时的任务,而人工合成的组织学图像则可以证明非常有益。在这项研究中,我们提出了一种不仅可以生成再现常见疾病诊断形态特征的组织学图像,还可以为用户提供生成新的罕见形态的方法。我们的方法涉及开发一种生成对抗网络模型,该模型可以根据类别标签来合成病理图像。我们研究了该框架在合成逼真的前列腺和结肠组织图像方面的能力,并评估了这些图像在增强机器学习方法的诊断能力及其供经验丰富的解剖病理学家使用的实用性。当使用深度学习模型进行诊断时,我们框架生成的合成数据与真实数据的表现相似。病理学家无法区分真实图像和合成图像,并且他们的分析表明,前列腺癌分级的观察者间一致性水平相似。我们将该方法扩展到来自结肠活检的更复杂的图像,并表明可以再现此类组织中复杂微环境的形态。最后,我们展示了用户使用简单的语义标签标记生成深度伪造组织学图像的能力。