Rodriguez Bryan, Zhang Xinxiang, Rajan Dinesh
Department of Electrical and Computer Engineering, Lyle School of Engineering, Southern Methodist University, Dallas, TX 75205, USA.
Sensors (Basel). 2023 Sep 23;23(19):8047. doi: 10.3390/s23198047.
The behavior of multicamera interference in 3D images (e.g., depth maps), which is based on infrared (IR) light, is not well understood. In 3D images, when multicamera interference is present, there is an increase in the amount of zero-value pixels, resulting in a loss of depth information. In this work, we demonstrate a framework for synthetically generating direct and indirect multicamera interference using a combination of a probabilistic model and ray tracing. Our mathematical model predicts the locations and probabilities of zero-value pixels in depth maps that contain multicamera interference. Our model accurately predicts where depth information may be lost in a depth map when multicamera interference is present. We compare the proposed synthetic 3D interference images with controlled 3D interference images captured in our laboratory. The proposed framework achieves an average root mean square error (RMSE) of 0.0625, an average peak signal-to-noise ratio (PSNR) of 24.1277 dB, and an average structural similarity index measure (SSIM) of 0.9007 for predicting direct multicamera interference, and an average RMSE of 0.0312, an average PSNR of 26.2280 dB, and an average SSIM of 0.9064 for predicting indirect multicamera interference. The proposed framework can be used to develop and test interference mitigation techniques that will be crucial for the successful proliferation of these devices.
基于红外(IR)光的多相机干扰在3D图像(如深度图)中的行为尚未得到充分理解。在3D图像中,当存在多相机干扰时,零值像素的数量会增加,从而导致深度信息丢失。在这项工作中,我们展示了一个使用概率模型和光线追踪相结合的框架,用于合成生成直接和间接多相机干扰。我们的数学模型预测了包含多相机干扰的深度图中零值像素的位置和概率。我们的模型准确地预测了存在多相机干扰时深度图中深度信息可能丢失的位置。我们将所提出的合成3D干扰图像与在我们实验室中捕获的受控3D干扰图像进行了比较。对于预测直接多相机干扰,所提出的框架实现了平均均方根误差(RMSE)为0.0625,平均峰值信噪比(PSNR)为24.1277 dB,平均结构相似性指数测量(SSIM)为0.9007;对于预测间接多相机干扰,平均RMSE为0.0312,平均PSNR为26.2280 dB,平均SSIM为0.9064。所提出的框架可用于开发和测试干扰缓解技术,这对于这些设备的成功推广至关重要。