Information and Communication Engineering, Electronics Information Engineering College, Changchun University of Science and Technology, Changchun 130022, China.
Electrical and Electronic Teaching Center, Electronics Information Engineering College, Changchun University, Changchun 130022, China.
Sensors (Basel). 2022 Feb 6;22(3):1237. doi: 10.3390/s22031237.
Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity images. However, the performance of reconstruction still suffers from noise and image data redundancy, which needs to be considered. In this paper, we present a novel Fourier ptychographic microscopy imaging reconstruction method based on a deep multi-feature transfer network, which can achieve good anti-noise performance and realize high-resolution reconstruction with reduced image data. First, in this paper, the image features are deeply extracted through transfer learning ResNet50, Xception and DenseNet121 networks, and utilize the complementarity of deep multiple features and adopt cascaded feature fusion strategy for channel merging to improve the quality of image reconstruction; then the pre-upsampling is used to reconstruct the network to improve the texture details of the high-resolution reconstructed image. We validate the performance of the reported method via both simulation and experiment. The model has good robustness to noise and blurred images. Better reconstruction results are obtained under the conditions of short time and low resolution. We hope that the end-to-end mapping method of neural network can provide a neural-network perspective to solve the FPM reconstruction.
傅里叶叠层显微镜(Fourier ptychographic microscopy,FPM)是一种潜在的成像技术,用于实现大视场(field-of-view,FOV)、高分辨率和定量相位信息。LED 阵列用于从不同角度照射样品,以获得相应的低分辨率强度图像。然而,重建的性能仍然受到噪声和图像数据冗余的影响,这需要加以考虑。在本文中,我们提出了一种基于深度多特征传递网络的新型傅里叶叠层显微镜成像重建方法,该方法可以实现良好的抗噪声性能,并通过减少图像数据实现高分辨率重建。首先,本文通过迁移学习 ResNet50、Xception 和 DenseNet121 网络对图像特征进行深度提取,并利用深度多特征的互补性,采用级联特征融合策略进行通道融合,以提高图像重建质量;然后采用预上采样对网络进行重建,以提高高分辨率重建图像的纹理细节。通过模拟和实验验证了所提出方法的性能。该模型对噪声和模糊图像具有良好的鲁棒性。在短时间和低分辨率的条件下,可以获得更好的重建结果。我们希望神经网络的端到端映射方法能够为 FPM 重建提供一种神经网络的视角。