Niu Xingman, Li Fuqian, Zuo Chenglin, Zhang Qican, Wang Yajun
Opt Express. 2024 Feb 12;32(4):5748-5759. doi: 10.1364/OE.509805.
Laser 3D measurement has gained widespread applications in industrial metrology . Still, it is usually limited by surfaces with high dynamic range (HDR) or the colorful surface texture of measured surfaces, such as metal and black industrial parts. Currently, conventional methods generally work with relatively strong-power laser intensities, which could potentially damage the sample or induce eye-safety concerns. For deep-learning-based methods, due to the different reflectivity of the measured surfaces, the HDR problem may require cumbersome adjustment of laser intensity in order to acquire enough training data. Even so, the problem of inaccurate ground truth may occur. To address these issues, this paper proposes the deep feature recovery (DFR) strategy to enhance low-light laser stripe images for achieving HDR 3D reconstruction with low cost, high robustness, and eye safety. To the best of our knowledge, this is the first attempt to tackle the challenge of high measurement costs associated with measuring HDR surfaces in laser 3D measurement. In learning the features of low-power laser images, the proposed strategy has a superior generalization ability and is insensitive to different low laser powers and variant surface reflectivity. To verify this point, we specially design the experiments by training the network merely using the diffusely reflective masks (DRM951) and testing the performance using diffusely reflective masks, metal surfaces, black industrial parts (contained in the constructed datasets DRO690, MO191, and BO107) and their hybrid scenes. Experimental results demonstrate that the proposed DFR strategy has good performances on robustness by testing different measurement scenes. For variously reflective surfaces, such as diffusely reflective surfaces, metal surfaces, and black parts surfaces, the reconstructed 3D shapes all have a similar quality to the reference method.
激光三维测量在工业计量领域已得到广泛应用。然而,它通常受到具有高动态范围(HDR)的表面或被测表面的彩色表面纹理的限制,例如金属和黑色工业部件。目前,传统方法通常在相对较强功率的激光强度下工作,这可能会潜在地损坏样品或引发眼睛安全问题。对于基于深度学习的方法,由于被测表面的反射率不同,HDR问题可能需要繁琐地调整激光强度以获取足够的训练数据。即便如此,仍可能出现地面真值不准确的问题。为了解决这些问题,本文提出了深度特征恢复(DFR)策略,以增强低光激光条纹图像,从而以低成本、高鲁棒性和眼睛安全性实现HDR三维重建。据我们所知,这是首次尝试应对激光三维测量中与测量HDR表面相关的高测量成本挑战。在学习低功率激光图像的特征时,所提出的策略具有卓越的泛化能力,并且对不同的低激光功率和变化的表面反射率不敏感。为了验证这一点,我们专门设计了实验,仅使用漫反射掩模(DRM951)训练网络,并使用漫反射掩模、金属表面、黑色工业部件(包含在构建的数据集DRO690、MO191和BO107中)及其混合场景测试性能。实验结果表明,所提出的DFR策略在测试不同测量场景时具有良好的鲁棒性。对于各种反射表面,如漫反射表面、金属表面和黑色部件表面,重建的三维形状与参考方法的质量都相似。