IEEE Trans Med Imaging. 2024 Oct;43(10):3634-3647. doi: 10.1109/TMI.2024.3430825. Epub 2024 Oct 28.
Histopathological examinations heavily rely on hematoxylin and eosin (HE) and immunohistochemistry (IHC) staining. IHC staining can offer more accurate diagnostic details but it brings significant financial and time costs. Furthermore, either re-staining HE-stained slides or using adjacent slides for IHC may compromise the accuracy of pathological diagnosis due to information loss. To address these challenges, we develop PST-Diff, a method for generating virtual IHC images from HE images based on diffusion models, which allows pathologists to simultaneously view multiple staining results from the same tissue slide. To maintain the pathological consistency of the stain transfer, we propose the asymmetric attention mechanism (AAM) and latent transfer (LT) module in PST-Diff. Specifically, the AAM can retain more local pathological information of the source domain images, while ensuring the model's flexibility in generating virtual stained images that highly confirm to the target domain. Subsequently, the LT module transfers the implicit representations across different domains, effectively alleviating the bias introduced by direct connection and further enhancing the pathological consistency of PST-Diff. Furthermore, to maintain the structural consistency of the stain transfer, the conditional frequency guidance (CFG) module is proposed to precisely control image generation and preserve structural details according to the frequency recovery process. To conclude, the pathological and structural consistency constraints provide PST-Diff with effectiveness and superior generalization in generating stable and functionally pathological IHC images with the best evaluation score. In general, PST-Diff offers prospective application in clinical virtual staining and pathological image analysis.
组织病理学检查严重依赖于苏木精和伊红(HE)染色和免疫组织化学(IHC)染色。IHC 染色可以提供更准确的诊断细节,但它带来了显著的经济和时间成本。此外,重新染色 HE 染色的幻灯片或使用相邻的幻灯片进行 IHC 可能会由于信息丢失而影响病理诊断的准确性。为了解决这些挑战,我们开发了 PST-Diff,这是一种基于扩散模型从 HE 图像生成虚拟 IHC 图像的方法,它允许病理学家同时从同一张组织幻灯片上查看多个染色结果。为了保持染色转移的病理一致性,我们在 PST-Diff 中提出了非对称注意机制(AAM)和潜在转移(LT)模块。具体来说,AAM 可以保留源域图像更多的局部病理信息,同时确保模型在生成高度符合目标域的虚拟染色图像时的灵活性。随后,LT 模块在不同域之间传输隐式表示,有效减轻了直接连接引入的偏差,进一步增强了 PST-Diff 的病理一致性。此外,为了保持染色转移的结构一致性,提出了条件频率引导(CFG)模块,根据频率恢复过程精确控制图像生成并保留结构细节。总之,病理和结构一致性约束为 PST-Diff 提供了有效性和卓越的泛化能力,生成稳定且功能病理 IHC 图像,并获得了最佳的评估分数。总的来说,PST-Diff 为临床虚拟染色和病理图像分析提供了有前景的应用。