State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, China.
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, China.
J Biophotonics. 2021 Jun;14(6):e202000444. doi: 10.1002/jbio.202000444. Epub 2021 Feb 24.
Fourier ptychographic microscopy is a promising imaging technique which can circumvent the space-bandwidth product of the system and achieve a reconstruction result with wide field-of-view (FOV), high-resolution and quantitative phase information. However, traditional iterative-based methods typically require multiple times to get convergence, and due to the wave vector deviation in different areas, the millimeter-level full-FOV cannot be well reconstructed once and typically required to be separated into several portions with sufficient overlaps and reconstructed separately, which makes traditional methods suffer from long reconstruction time for a large-FOV (of the order of minutes) and limits the application in real-time large-FOV monitoring of live sample in vitro. Here we propose a novel deep-learning based method called DFNN which can be used in place of traditional iterative-based methods to increase the quality of single large-FOV reconstruction and reducing the processing time from 167.5 to 0.1125 second. In addition, we demonstrate that by training based on the simulation dataset with high-entropy property (Opt. Express 28, 24 152 [2020]), DFNN could has fine generalizability and little dependence on the morphological features of samples. The superior robustness of DFNN against noise is also demonstrated in both simulation and experiment. Furthermore, our model shows more robustness against the wave vector deviation. Therefore, we could achieve better results at the edge areas of a single large-FOV reconstruction. Our method demonstrates a promising way to perform real-time single large-FOV reconstructions and provides further possibilities for real-time large-FOV monitoring of live samples with sub-cellular resolution.
傅里叶叠层显微镜是一种很有前途的成像技术,可以规避系统的空间带宽积,实现大视场(FOV)、高分辨率和定量相位信息的重建结果。然而,传统的基于迭代的方法通常需要多次才能收敛,并且由于不同区域的波矢偏差,毫米级全 FOV 不能一次很好地重建,通常需要分成几个具有足够重叠的部分并分别重建,这使得传统方法在实时大 FOV 监测体外活样本方面存在很长的重建时间限制。在这里,我们提出了一种新的基于深度学习的方法称为 DFNN,可以替代传统的基于迭代的方法,以提高单一大 FOV 重建的质量,并将处理时间从 167.5 秒减少到 0.1125 秒。此外,我们证明通过基于具有高熵特性的模拟数据集进行训练(Opt. Express 28, 24152 [2020]),DFNN 具有很好的泛化能力,对样本的形态特征依赖性较小。DFNN 在模拟和实验中对噪声的稳健性也得到了证明。此外,我们的模型显示出对波矢偏差更好的鲁棒性。因此,我们可以在单个大 FOV 重建的边缘区域获得更好的结果。我们的方法展示了一种实时单一大 FOV 重建的有前途的方法,并为具有亚细胞分辨率的实时大 FOV 监测活体样本提供了进一步的可能性。