Liu Wei, Delikoyun Kerem, Chen Qianyu, Yildiz Alperen, Myo Si Ko, Kuan Win Sen, Soong John Tshon Yit, Cove Matthew Edward, Hayden Oliver, Lee Hwee Kuan
Bioinformatics Institute, Agency for Science, Technology and Research, 30 Biopolis Street, 138671, Singapore.
School of Computation, Information and Technology, Technical University of Munich, Arcisstr. 21, 80333, Munich, Germany.
Biomed Opt Express. 2025 Feb 4;16(3):894-909. doi: 10.1364/BOE.547292. eCollection 2025 Mar 1.
Off-axis digital holographic microscopy is a high-throughput, label-free imaging technology that provides three-dimensional, high-resolution information about samples, which is particularly useful in large-scale cellular imaging. However, the hologram reconstruction process poses a significant bottleneck for timely data analysis. To address this challenge, we propose a novel reconstruction approach that integrates deep learning with the physical principles of off-axis holography. We initialized part of the network weights based on the physical principle and then fine-tuned them via supersized learning. Our off-axis hologram network (OAH-Net) retrieves phase and amplitude images with errors that fall within the measurement error range attributable to hardware, and its reconstruction speed significantly surpasses the microscope's acquisition rate. Crucially, OAH-Net, trained and validated on diluted whole blood samples, demonstrates remarkable external generalization capabilities on unseen samples with distinct patterns. Additionally, it can be seamlessly integrated with other models for downstream tasks, enabling end-to-end real-time hologram analysis. This capability further expands off-axis holography's applications in both biological and medical studies.
离轴数字全息显微镜是一种高通量、无标记的成像技术,可提供有关样品的三维高分辨率信息,这在大规模细胞成像中特别有用。然而,全息图重建过程对及时进行数据分析构成了重大瓶颈。为应对这一挑战,我们提出了一种将深度学习与离轴全息术的物理原理相结合的新颖重建方法。我们基于物理原理初始化部分网络权重,然后通过超大规模学习对其进行微调。我们的离轴全息图网络(OAH-Net)检索到的相位和幅度图像的误差落在硬件可归因的测量误差范围内,并且其重建速度显著超过显微镜的采集速率。至关重要的是,在稀释的全血样本上进行训练和验证的OAH-Net在具有不同模式的未见样本上表现出卓越的外部泛化能力。此外,它可以与其他模型无缝集成以用于下游任务,实现端到端的实时全息图分析。这种能力进一步扩展了离轴全息术在生物学和医学研究中的应用。