Zhou Ming
Zhou Ming Anhui Sanlian College, Hefei, China.
PeerJ Comput Sci. 2024 Feb 29;10:e1864. doi: 10.7717/peerj-cs.1864. eCollection 2024.
With the development of computer technology leading to a broad range of virtual technology implementations, the construction of virtual tasks has become highly demanded and has increased rapidly, especially in animation scenes. Constructing three-dimensional (3D) animation characters utilizing properties of actual characters could provide users with immersive experiences. However, a 3D face reconstruction (3DFR) utilizing a single image is a very demanding operation in computer graphics and vision. In addition, limited 3D face data sets reduce the performance improvement of the proposed approaches, causing a lack of robustness. When datasets are large, face recognition, transformation, and animation implementations are relatively practical. However, some reconstruction methods only consider the one-to-one processes without considering the correlations or differences in the input images, resulting in models lacking information related to face identity or being overly sensitive to face pose. A face model composed of a convolutional neural network (CNN) regresses 3D deformable model coefficients for 3DFR and alignment tasks. The manuscript proposes a reconstruction method for 3D animation scenes employing fuzzy LSMT-CNN (FLSMT-CNN). Multiple collected images are employed to reconstruct 3D animation characters. First, the serialized images are processed by the proposed method to extract the features of face parameters and then improve the conventional deformable face modeling (3DFDM). Afterward, the 3DFDM is utilized to reconstruct animation characters, and finally, high-precision reconstructions of 3D faces are achieved. The FLSMT-CNN has enhanced both the precision and strength of the reconstructed 3D animation characters, which provides more opportunities to be applied to other animation scenes.
随着计算机技术的发展带来了广泛的虚拟技术应用,虚拟任务的构建需求大增且迅速发展,尤其是在动画场景中。利用真实角色的属性构建三维(3D)动画角色可为用户提供沉浸式体验。然而,利用单张图像进行3D面部重建(3DFR)在计算机图形学和视觉领域是一项极具挑战性的操作。此外,有限的3D面部数据集降低了所提方法的性能提升,导致缺乏鲁棒性。当数据集较大时,人脸识别、变换和动画实现相对可行。然而,一些重建方法只考虑一对一的过程,而不考虑输入图像之间的相关性或差异,导致模型缺乏与面部身份相关的信息或对面部姿态过于敏感。由卷积神经网络(CNN)组成的面部模型回归用于3DFR和对齐任务的3D可变形模型系数。本文提出了一种采用模糊最小二乘支持向量机 - 卷积神经网络(FLSMT - CNN)的3D动画场景重建方法。使用多个采集的图像来重建3D动画角色。首先,通过所提方法处理序列化图像以提取面部参数特征,然后改进传统的可变形面部建模(3DFDM)。之后,利用3DFDM重建动画角色,最终实现3D面部的高精度重建。FLSMT - CNN提高了重建的3D动画角色的精度和强度,为应用于其他动画场景提供了更多机会。