Park Eunwoo, Misra Sampa, Hwang Dong Gyu, Yoon Chiho, Ahn Joongho, Kim Donggyu, Jang Jinah, Kim Chulhong
Department of Convergence IT Engineering, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea.
Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea.
Nat Commun. 2024 Dec 30;15(1):10892. doi: 10.1038/s41467-024-55262-2.
Mid-infrared photoacoustic microscopy can capture biochemical information without staining. However, the long mid-infrared optical wavelengths make the spatial resolution of photoacoustic microscopy significantly poorer than that of conventional confocal fluorescence microscopy. Here, we demonstrate an explainable deep learning-based unsupervised inter-domain transformation of low-resolution unlabeled mid-infrared photoacoustic microscopy images into confocal-like virtually fluorescence-stained high-resolution images. The explainable deep learning-based framework is proposed for this transformation, wherein an unsupervised generative adversarial network is primarily employed and then a saliency constraint is added for better explainability. We validate the performance of explainable deep learning-based mid-infrared photoacoustic microscopy by identifying cell nuclei and filamentous actins in cultured human cardiac fibroblasts and matching them with the corresponding CFM images. The XDL ensures similar saliency between the two domains, making the transformation process more stable and more reliable than existing networks. Our XDL-MIR-PAM enables label-free high-resolution duplexed cellular imaging, which can significantly benefit many research avenues in cell biology.
中红外光声显微镜无需染色就能获取生物化学信息。然而,较长的中红外光波长使得光声显微镜的空间分辨率明显低于传统共聚焦荧光显微镜。在此,我们展示了一种基于可解释深度学习的无监督域间转换方法,可将低分辨率未标记的中红外光声显微镜图像转换为类似共聚焦的虚拟荧光染色高分辨率图像。为此转换提出了基于可解释深度学习的框架,其中主要采用无监督生成对抗网络,然后添加显著性约束以提高可解释性。我们通过识别培养的人心脏成纤维细胞中的细胞核和丝状肌动蛋白,并将它们与相应的共聚焦显微镜图像匹配,来验证基于可解释深度学习的中红外光声显微镜的性能。XDL确保了两个域之间相似的显著性,使得转换过程比现有网络更稳定、更可靠。我们的XDL-MIR-PAM实现了无标记高分辨率双细胞成像,这可以显著惠及细胞生物学的许多研究领域。