Baek Eu-Tteum, Yang Hyung-Jeong, Kim Soo-Hyung, Lee Gueesang, Jeong Hieyong
Department of Electronics and Computer Engineering, Chonnam National University, 77 Yongbong-ro, Gwangju 61186, Korea.
Sensors (Basel). 2020 Feb 20;20(4):1156. doi: 10.3390/s20041156.
A distance map captured using a time-of-flight (ToF) depth sensor has fundamental problems, such as ambiguous depth information in shiny or dark surfaces, optical noise, and mismatched boundaries. Severe depth errors exist in shiny and dark surfaces owing to excess reflection and excess absorption of light, respectively. Dealing with this problem has been a challenge due to the inherent hardware limitations of ToF, which measures the distance using the number of reflected photons. This study proposes a distance error correction method using three ToF sensors, set to different integration times to address the ambiguity in depth information. First, the three ToF depth sensors are installed horizontally at different integration times to capture distance maps at different integration times. Given the amplitude maps and error regions are estimated based on the amount of light, the estimated error regions are refined by exploiting the accurate depth information from the neighboring depth sensors that use different integration times. Moreover, we propose a new optical noise reduction filter that considers the distribution of the depth information biased toward one side. Experimental results verified that the proposed method overcomes the drawbacks of ToF cameras and provides enhanced distance maps.
使用飞行时间(ToF)深度传感器捕获的距离图存在一些基本问题,例如在光亮或黑暗表面中深度信息模糊、光学噪声以及边界不匹配。由于光的过度反射和过度吸收,光亮表面和黑暗表面分别存在严重的深度误差。由于ToF的固有硬件限制(它使用反射光子的数量来测量距离),处理这个问题一直是一个挑战。本研究提出了一种使用三个ToF传感器的距离误差校正方法,这些传感器设置为不同的积分时间,以解决深度信息的模糊性。首先,将三个ToF深度传感器水平安装在不同的积分时间,以在不同的积分时间捕获距离图。鉴于基于光量估计出幅度图和误差区域,通过利用来自使用不同积分时间的相邻深度传感器的准确深度信息来细化估计出的误差区域。此外,我们提出了一种新的光学降噪滤波器,该滤波器考虑了偏向一侧的深度信息分布。实验结果验证了所提出的方法克服了ToF相机的缺点,并提供了增强的距离图。