School of Computer Science and Engineering, Macau University of Science and Technology, 999078, Macao Special Administrative Region of China.
School of Computer Science and Engineering, Macau University of Science and Technology, 999078, Macao Special Administrative Region of China; State Key Laboratory of Lunar and Planetary Sciences, Macau University of Science and Technology, 999078, Macao Special Administrative Region of China.
Neural Netw. 2022 Nov;155:28-38. doi: 10.1016/j.neunet.2022.08.007. Epub 2022 Aug 15.
StyleGAN is now capable of achieving excellent results, especially high-quality face synthesis. Recently, some studies have tried to invert real face images into style latent space via StyleGAN. However, morphing real faces via latent representation is still in its infancy. Training costs are high and/or require huge samples with labels. By adding regularization to style optimization, we propose a novel method to morph real faces based on StyleGAN. To do the supervised task, we label latent vectors via synthesized faces and release the label set; then we utilize logistic regression to fast discover interpretable directions in latent space. Appropriate regularization helps us to optimize both latent vectors (faces and directions). Moreover, we use learned directions under different layer representations to handle real face morphing. Compared to the existing methods, our method faster yields a larger diverse and realistic output. Code and cases are available at https://github.com/disanda/RFM.
StyleGAN 现在能够取得优异的成果,尤其是在高质量人脸合成方面。最近,一些研究试图通过 StyleGAN 将真实人脸图像反转到风格潜在空间中。然而,通过潜在表示来变形真实人脸仍处于起步阶段。训练成本高,且/或需要带有标签的大量样本。通过在风格优化中添加正则化项,我们提出了一种基于 StyleGAN 的新方法来实现真实人脸的变形。为了完成监督任务,我们通过合成人脸对潜在向量进行标注,并发布标注集;然后我们利用逻辑回归快速发现潜在空间中可解释的方向。适当的正则化有助于我们优化潜在向量(人脸和方向)。此外,我们使用不同层表示下学习到的方向来处理真实人脸的变形。与现有方法相比,我们的方法可以更快地生成更大、更多样化和更真实的输出。代码和案例可在 https://github.com/disanda/RFM 上获取。