Yuan Quan, Wu Jingjing, Zhang Huanlong, Yu Jinmiao, Ye Yunpeng
Appl Opt. 2023 Sep 20;62(27):7299-7315. doi: 10.1364/AO.498534.
Microscopic fringe projection profilometry (MFPP) technology is widely used in 3D measurement. The measurement precision performed by the MFPP system is closely related to the calibration accuracy. However, owing to the shallow depth of field, calibration in MFPP is frequently influenced by low-quality target images, which would generate inaccurate features and calibration parameter estimates. To alleviate the problem, this paper proposes an unsupervised-learning-based calibration robust to defocus and noise, which could effectively enhance the image quality and increase calibration accuracy. In this method, first, an unsupervised image deblurring network (UIDNet) is developed to recover a sharp target image from the deteriorated one. Free from capturing strictly paired images by a specific vision system or generating the dataset by simulation, the unsupervised deep learning framework can learn more accurate features from the multi-quality target dataset of convenient image acquisition. Second, multi-perceptual loss and Fourier frequency loss are introduced into the UIDNet to improve the training performance. Third, a robust calibration compensation strategy based on 2D discrete Fourier transform is also developed to evaluate the image quality and improve the detection accuracy of the reference feature centers for fine calibration. The relevant experiments demonstrate that the proposed calibration method can achieve superior performance in terms of calibration accuracy and measurement precision.
微观条纹投影轮廓术(MFPP)技术在三维测量中被广泛应用。MFPP系统的测量精度与校准精度密切相关。然而,由于景深较浅,MFPP中的校准经常受到低质量目标图像的影响,这会产生不准确的特征和校准参数估计。为缓解该问题,本文提出一种对散焦和噪声具有鲁棒性的基于无监督学习的校准方法,其可有效提高图像质量并提升校准精度。在该方法中,首先,开发了一种无监督图像去模糊网络(UIDNet),用于从退化图像中恢复清晰的目标图像。该无监督深度学习框架无需通过特定视觉系统严格采集配对图像或通过模拟生成数据集,而是可以从方便采集的多质量目标数据集中学习更准确的特征。其次,将多感知损失和傅里叶频率损失引入UIDNet以提高训练性能。第三,还开发了一种基于二维离散傅里叶变换的鲁棒校准补偿策略,以评估图像质量并提高参考特征中心的检测精度用于精细校准。相关实验表明,所提出的校准方法在校准精度和测量精度方面均可实现卓越性能。