Kassab Mohamad, Jehanzaib Muhammad, Başak Kayhan, Demir Derya, Keles G Evren, Turan Mehmet
Department of Computer Engineering, Bogazici University, Istanbul, Turkey.
Sağlık Bilimleri University, Kartal Dr.Lütfi Kırdar City Hospital, Department of Pathology, Istanbul, Turkey.
Med Image Anal. 2024 Jan;91:102992. doi: 10.1016/j.media.2023.102992. Epub 2023 Oct 12.
Formalin-fixation and paraffin-embedding (FFPE) is a technique for preparing and preserving tissue specimens that has been utilized in histopathology since the late 19th century. This process is further complicated by FFPE preparation steps such as fixation, processing, embedding, microtomy, staining, and coverslipping, which often results in artifacts due to the complex histological and cytological characteristics of a tissue specimen. The term "artifacts" includes, but is not limited to, staining inconsistencies, tissue folds, chattering, pen marks, blurring, air bubbles, and contamination. The presence of artifacts may interfere with pathological diagnosis in disease detection, subtyping, grading, and choice of therapy. In this study, we propose FFPE++, an unpaired image-to-image translation method based on contrastive learning with a mixed channel-spatial attention module and self-regularization loss that drastically corrects the aforementioned artifacts in FFPE tissue sections. Turing tests were performed by 10 board-certified pathologists with more than 10 years of experience. These tests which were performed for ovarian carcinoma, lung adenocarcinoma, lung squamous cell carcinoma, and papillary thyroid carcinoma, demonstrate the clear superiority of the proposed method in many clinical aspects compared with standard FFPE images. Based on the qualitative experiments and feedback from the Turing tests, we believe that FFPE++ can contribute to substantial diagnostic and prognostic accuracy in clinical pathology in the future and can also improve the performance of AI tools in digital pathology. The code and dataset are publicly available at https://github.com/DeepMIALab/FFPEPlus.
福尔马林固定石蜡包埋(FFPE)是一种自19世纪末以来一直在组织病理学中用于制备和保存组织标本的技术。由于FFPE的制备步骤,如固定、处理、包埋、切片、染色和封片,该过程变得更加复杂,由于组织标本复杂的组织学和细胞学特征,这些步骤常常会导致伪像。“伪像”一词包括但不限于染色不一致、组织褶皱、震颤、笔痕、模糊、气泡和污染。伪像的存在可能会干扰疾病检测、亚型分类、分级和治疗选择中的病理诊断。在本研究中,我们提出了FFPE++,这是一种基于对比学习的无配对图像到图像转换方法,具有混合通道空间注意力模块和自正则化损失,可大幅校正FFPE组织切片中的上述伪像。由10位具有10年以上经验的获得委员会认证的病理学家进行了图灵测试。这些针对卵巢癌、肺腺癌、肺鳞状细胞癌和甲状腺乳头状癌进行的测试表明,与标准FFPE图像相比,该方法在许多临床方面具有明显优势。基于定性实验和图灵测试的反馈,我们相信FFPE++未来可以提高临床病理学中的诊断和预后准确性,还可以提高数字病理学中人工智能工具的性能。代码和数据集可在https://github.com/DeepMIALab/FFPEPlus上公开获取。