Yu Cuican, Zhang Zihui, Li Huibin, Liu Chang
Department of Hepatobiliary Surgery, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an 710004, China.
Department of Computing, Hong Kong Polytechnic University, Hong Kong 999077, China.
Sensors (Basel). 2025 Aug 14;25(16):5049. doi: 10.3390/s25165049.
The development of deep learning-based 3D face recognition has been constrained by the limited availability of large-scale 3D facial datasets, which are costly and labor-intensive to acquire. To address this challenge, we propose a novel 2D-aided framework that reconstructs 3D face geometries from abundant 2D images, enabling scalable and cost-effective data augmentation for 3D face recognition. Our pipeline integrates 3D face reconstruction with normal component image encoding and fine-tunes a deep face recognition model to learn discriminative representations from synthetic 3D data. Experimental results on four public benchmarks, i.e., the BU-3DFE, FRGC v2, Bosphorus, and BU-4DFE databases, demonstrate competitive rank-1 accuracies of 99.2%, 98.4%, 99.3%, and 96.5%, respectively, despite the absence of real 3D training data. We further evaluate the impact of alternative reconstruction methods and empirically demonstrate that higher-fidelity 3D inputs improve recognition performance. While synthetic 3D face data may lack certain fine-grained geometric details, our results validate their effectiveness for practical recognition tasks under diverse expressions and demographic conditions. This work provides an efficient and scalable paradigm for 3D face recognition by leveraging widely available face images, offering new insights into data-efficient training strategies for biometric systems.
基于深度学习的3D人脸识别技术的发展受到大规模3D人脸数据集可用性的限制,这类数据集获取成本高且劳动强度大。为应对这一挑战,我们提出了一种新颖的二维辅助框架,该框架可从大量二维图像中重建3D人脸几何形状,从而实现用于3D人脸识别的可扩展且经济高效的数据增强。我们的流程将3D人脸重建与法线分量图像编码相结合,并对深度人脸识别模型进行微调,以从合成3D数据中学习判别性表示。在四个公共基准数据集上的实验结果,即BU-3DFE、FRGC v2、博斯普鲁斯和BU-4DFE数据库,分别展示了具有竞争力的99.2%、98.4%、99.3%和96.5%的一级准确率,尽管没有真实的3D训练数据。我们进一步评估了替代重建方法的影响,并通过实验证明了更高保真度的3D输入可提高识别性能。虽然合成3D人脸数据可能缺乏某些细粒度的几何细节,但我们的结果验证了它们在不同表情和人口统计条件下对实际识别任务的有效性。这项工作通过利用广泛可用的人脸图像,为3D人脸识别提供了一种高效且可扩展的范式,为生物识别系统的数据高效训练策略提供了新的见解。