Suppr超能文献

PGT-NeuS:用于神经表面重建的渐进式生长三平面表示法

PGT-NeuS: Progressive-Growing Tri-Plane Representation for Neural Surface Reconstruction.

作者信息

Xiang Xue-Kun, Yuan Yu-Jie, Hu Wen-Bo, Liu Yu-Tao, Ma Yue-Wen, Gao Lin

出版信息

IEEE Trans Vis Comput Graph. 2025 Oct;31(10):9213-9224. doi: 10.1109/TVCG.2025.3590394.

Abstract

3D reconstruction from multi-view images is a long-standing problem in computer graphic. Neural 3D reconstruction, especially NeuS and its variants, has improved reconstruction quality compared to traditional methods. However, it is still a challenge for these methods to reconstruct fine-grained geometric details since the spherical harmonic positional encoding lacks the ability to express high-frequency signals. In this paper, we propose a multi-resolution tri-plane feature encoding that leverages the detail reconstruction capabilities of high-resolution tri-plane while using the smoothness of low-resolution tri-plane to suppress high-frequency artifacts. Additionally, a progressive training strategy is introduced, gradually merging scene details from coarse to fine granularity, enhancing reconstruction quality while maintaining training stability and reducing difficulty. Furthermore, to address reconstruction challenges arising from sparse viewpoints and inconsistent lighting in image datasets, we introduce normal priors as supervision and propose consistency verification for multi-view normal priors, which assesses the accuracy of normal priors and effectively supervise the reconstructed surfaces. Moreover, we propose a perturbing and fine-tuning strategy on regions of unreliable normal priors to further improve the quality of geometric surface reconstruction.

摘要

从多视图图像进行3D重建是计算机图形学中一个长期存在的问题。神经3D重建,特别是NeuS及其变体,与传统方法相比提高了重建质量。然而,由于球谐位置编码缺乏表达高频信号的能力,这些方法重建细粒度几何细节仍然是一个挑战。在本文中,我们提出了一种多分辨率三平面特征编码,它利用高分辨率三平面的细节重建能力,同时利用低分辨率三平面的平滑性来抑制高频伪影。此外,引入了一种渐进训练策略,从粗粒度到细粒度逐步合并场景细节,在保持训练稳定性和降低难度的同时提高重建质量。此外,为了解决图像数据集中稀疏视点和不一致光照带来的重建挑战,我们引入法线先验作为监督,并提出多视图法线先验的一致性验证,以评估法线先验的准确性并有效地监督重建表面。此外,我们针对不可靠法线先验的区域提出了一种扰动和微调策略,以进一步提高几何表面重建的质量。

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验