IEEE Trans Pattern Anal Mach Intell. 2017 Aug;39(8):1591-1604. doi: 10.1109/TPAMI.2016.2608944. Epub 2016 Sep 13.
We propose a robust uncalibrated multiview photometric stereo method for high quality 3D shape reconstruction. In our method, a coarse initial 3D mesh obtained using a multiview stereo method is projected onto a 2D planar domain using a planar mesh parameterization technique. We describe methods for surface normal estimation that work in the parameterized 2D space that jointly incorporates all geometric and photometric cues from multiple viewpoints. Using an estimated surface normal map, a refined 3D mesh is then recovered by computing an optimal displacement map in the same 2D planar domain. Our method avoids the need of merging view-dependent surface normal maps that is often required in conventional methods. We conduct evaluation on various real-world objects containing surfaces with specular reflections, multiple albedos, and complex topologies in both controlled and uncontrolled settings and demonstrate that accurate 3D meshes with fine geometric details can be recovered by our method.
我们提出了一种鲁棒的非标定多视图光度立体方法，用于高质量的三维形状重建。在我们的方法中，使用多视图立体方法获得的粗糙初始三维网格使用平面网格参数化技术投影到二维平面域上。我们描述了在参数化的二维空间中工作的表面法向估计方法，该方法联合利用了来自多个视点的所有几何和光度线索。使用估计的表面法线图，然后通过在相同的二维平面域中计算最佳位移图来恢复细化的三维网格。我们的方法避免了在传统方法中通常需要的合并视图相关表面法线图的需求。我们在受控和非受控环境中对各种包含具有镜面反射、多个反射率和复杂拓扑的表面的真实物体进行了评估，并证明我们的方法可以恢复具有精细几何细节的准确三维网格。
