IEEE Trans Image Process. 2021;30:1086-1099. doi: 10.1109/TIP.2020.3042082. Epub 2020 Dec 11.
Spoofing attacks are critical threats to modern face recognition systems, and most common countermeasures exploit 2D texture features as they are easy to extract and deploy. 3D shape-based methods can substantially improve spoofing prevention, but extracting the 3D shape of the face often requires complex hardware such as a 3D scanner and expensive computation. Motivated by the classical shape-from-shading model, we propose to obtain 3D facial features that can be used to recognize the presence of an actual 3D face, without explicit shape reconstruction. Such shading-based 3D features are extracted highly efficiently from a pair of images captured under different illumination, e.g., two images captured with and without flash. Thus the proposed method provides a rich 3D geometrical representation at negligible computational cost and minimal to none additional hardware. A theoretical analysis is provided to support why such simple 3D features can effectively describe the presence of an actual 3D shape while avoiding complicated calibration steps or hardware setup. Experimental validation shows that the proposed method can produce state-of-the-art spoofing prevention and enhance existing texture-based solutions.
伪造攻击是现代人脸识别系统的重大威胁,大多数常见的对策都利用 2D 纹理特征,因为它们易于提取和部署。基于 3D 形状的方法可以大大提高防范伪造的能力,但提取人脸的 3D 形状通常需要复杂的硬件,如 3D 扫描仪和昂贵的计算。受经典的阴影形状模型的启发,我们提出了一种方法,从不同光照下拍摄的一对图像中获取可用于识别实际 3D 人脸的存在的 3D 面部特征,而无需进行明确的形状重建。这种基于阴影的 3D 特征可以从一对图像中高效地提取出来,例如在有和没有闪光灯的情况下拍摄的两张图像。因此,该方法以可忽略的计算成本和最小的额外硬件提供了丰富的 3D 几何表示。提供了理论分析来支持为什么这种简单的 3D 特征可以有效地描述实际 3D 形状的存在,同时避免复杂的校准步骤或硬件设置。实验验证表明,该方法可以实现最新的伪造预防,并增强现有的基于纹理的解决方案。