Department of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea.
Department of IT Engineering, Sookmyung Women's University, Seoul 04310, Korea.
Sensors (Basel). 2022 May 30;22(11):4142. doi: 10.3390/s22114142.
It is possible to construct cost-efficient three-dimensional (3D) or four-dimensional (4D) scanning systems using multiple affordable off-the-shelf RGB-D sensors to produce high-quality reconstructions of 3D objects. However, the quality of these systems' reconstructions is sensitive to a number of factors in reconstruction pipelines, such as multi-view calibration, depth estimation, 3D reconstruction, and color mapping accuracy, because the successive pipelines to reconstruct 3D meshes from multiple active stereo sensors are strongly correlated with each other. This paper categorizes the pipelines into sub-procedures and analyze various factors that can significantly affect reconstruction quality. Thus, this paper provides analytical and practical guidelines for high-quality 3D reconstructions with off-the-shelf sensors. For each sub-procedure, this paper shows comparisons and evaluations of several methods using data captured by 18 RGB-D sensors and provide analyses and discussions towards robust 3D reconstruction. Through various experiments, it has been demonstrated that significantly more accurate 3D scans can be obtained with the considerations along the pipelines. We believe our analyses, benchmarks, and guidelines will help anyone build their own studio and their further research for 3D reconstruction.
使用多个价格实惠的现成 RGB-D 传感器构建具有成本效益的三维 (3D) 或四维 (4D) 扫描系统，可以生成高质量的 3D 物体重建。然而，这些系统的重建质量对重建管道中的许多因素很敏感，例如多视图校准、深度估计、3D 重建和颜色映射精度，因为从多个主动立体传感器重建 3D 网格的连续管道彼此之间具有很强的相关性。本文将管道分为子过程，并分析了可能显著影响重建质量的各种因素。因此，本文为使用现成传感器进行高质量 3D 重建提供了分析和实用指南。对于每个子过程，本文使用 18 个 RGB-D 传感器捕获的数据展示了几种方法的比较和评估，并对稳健的 3D 重建进行了分析和讨论。通过各种实验，已经证明沿着这些管道进行考虑可以获得更准确的 3D 扫描。我们相信我们的分析、基准测试和指南将帮助任何人构建自己的工作室，并为他们的 3D 重建进一步研究提供帮助。
