Cui Jiadi, Zhang Jiajie, Kneip Laurent, Schwertfeger Sören
Key Laboratory of Intelligent Perception and Human-Machine Collaboration, ShanghaiTech University, Ministry of Education, Shanghai 201210, China.
Sensors (Basel). 2024 Oct 28;24(21):6919. doi: 10.3390/s24216919.
Efficiently reconstructing complex and intricate surfaces at scale remains a significant challenge in 3D surface reconstruction. Recently, implicit neural representations have become a popular topic in 3D surface reconstruction. However, how to handle loop closure and bundle adjustment is a tricky problem for neural methods, because they learn the neural parameters globally. We present an algorithm that leverages the concept of surfels and expands relevant definitions to address such challenges. By integrating neural descriptors with surfels and framing surfel association as a deformation graph optimization problem, our method is able to effectively perform loop closure detection and loop correction in challenging scenarios. Furthermore, the surfel-level representation simplifies the complexity of 3D neural reconstruction. Meanwhile, the binding of neural descriptors to corresponding surfels produces a dense volumetric signed distance function (SDF), enabling the mesh reconstruction. Our approach demonstrates a significant improvement in reconstruction accuracy, reducing the average error by 16.9% compared to previous methods, while also generating modeling files that are up to 90% smaller than those produced by traditional methods.
在大规模场景下高效重建复杂精细的表面仍然是三维表面重建中的一项重大挑战。最近,隐式神经表示已成为三维表面重建中的一个热门话题。然而,对于神经方法来说,如何处理循环闭合和束调整是一个棘手的问题,因为它们是全局学习神经参数的。我们提出了一种算法,该算法利用表面元素的概念并扩展相关定义来应对此类挑战。通过将神经描述符与表面元素相结合,并将表面元素关联构建为变形图优化问题,我们的方法能够在具有挑战性的场景中有效地执行循环闭合检测和循环校正。此外,表面元素级别的表示简化了三维神经重建的复杂性。同时,神经描述符与相应表面元素的结合产生了一个密集的体符号距离函数(SDF),从而实现网格重建。我们的方法在重建精度上有显著提高,与之前的方法相比,平均误差降低了16.9%,同时生成的建模文件比传统方法生成的文件小90%。