Zheng Qian, Kumar Ajay, Shi Boxin, Pan Gang
IEEE Trans Image Process. 2019 Jul;28(7):3177-3191. doi: 10.1109/TIP.2019.2894963. Epub 2019 Jan 24.
The surface normal estimation from photometric stereo becomes less reliable when the surface reflectance deviates from the Lambertian assumption. The non-Lambertian effect can be explicitly addressed by physics modeling to the reflectance function, at the cost of introducing highly nonlinear optimization. This paper proposes a numerical compensation scheme that attempts to minimize the angular error to address the non-Lambertian photometric stereo problem. Due to the multifaceted influence in the modeling of non-Lambertian reflectance in photometric stereo, directly minimizing the angular errors of surface normal is a highly complex problem. We introduce an alternating strategy, in which the estimated reflectance can be temporarily regarded as a known variable, to simplify the formulation of angular error. To reduce the impact of inaccurately estimated reflectance in this simplification, we propose a numerical compensation scheme whose compensation weight is formulated to reflect the reliability of estimated reflectance. Finally, the solution for the proposed numerical compensation scheme is efficiently computed by using cosine difference to approximate the angular difference. The experimental results show that our method can significantly improve the performance of the state-of-the-art methods on both synthetic data and real data with small additive costs. Moreover, our method initialized by results from the baseline method (least-square-based) achieves the state-of-the-art performance on both synthetic data and real data with significantly smaller overall computation, i.e., about eight times faster compared with the state-of-the-art methods.
当表面反射率偏离朗伯体假设时,基于光度立体视觉的表面法线估计变得不太可靠。非朗伯体效应可以通过对反射率函数进行物理建模来明确解决,但代价是引入高度非线性优化。本文提出了一种数值补偿方案,试图通过最小化角度误差来解决非朗伯体光度立体视觉问题。由于光度立体视觉中非朗伯体反射率建模存在多方面影响,直接最小化表面法线的角度误差是一个高度复杂的问题。我们引入一种交替策略,其中估计的反射率可以暂时视为已知变量,以简化角度误差的公式。为了减少这种简化中估计反射率不准确的影响,我们提出一种数值补偿方案,其补偿权重被制定为反映估计反射率的可靠性。最后,通过使用余弦差来近似角度差,有效地计算了所提出数值补偿方案的解。实验结果表明,我们的方法在合成数据和真实数据上都能以较小的附加成本显著提高现有方法的性能。此外,我们的方法以基线方法(基于最小二乘法)的结果初始化,在合成数据和真实数据上都实现了最先进的性能,且总体计算量显著更小,即与最先进方法相比快约八倍。