• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

引导式风格:用于语义人脸编辑的属性知识引导式风格操控。

GuidedStyle: Attribute knowledge guided style manipulation for semantic face editing.

机构信息

Computer Vision Institute, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China; Shenzhen Institute of Artificial Intelligence and Robotics for Society, Shenzhen, China; Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, China.

Computer Vision Institute, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China; Shenzhen Institute of Artificial Intelligence and Robotics for Society, Shenzhen, China; Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, China.

出版信息

Neural Netw. 2022 Jan;145:209-220. doi: 10.1016/j.neunet.2021.10.017. Epub 2021 Oct 28.

DOI:10.1016/j.neunet.2021.10.017
PMID:34768091
Abstract

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there is still a lack of control over the generation process in order to achieve semantic face editing. In this paper, we propose a novel learning framework, called GuidedStyle, to achieve semantic face editing on pretrained StyleGAN by guiding the image generation process with a knowledge network. Furthermore, we allow an attention mechanism in StyleGAN generator to adaptively select a single layer for style manipulation. As a result, our method is able to perform disentangled and controllable edits along various attributes, including smiling, eyeglasses, gender, mustache, hair color and attractive. Both qualitative and quantitative results demonstrate the superiority of our method over other competing methods for semantic face editing. Moreover, we show that our model can be also applied to different types of real and artistic face editing, demonstrating strong generalization ability.

摘要

尽管无条件生成对抗网络 (GANs) 在合成高质量、逼真的人脸图像方面取得了重大进展,但在实现语义人脸编辑方面,仍然缺乏对生成过程的控制。在本文中,我们提出了一种新颖的学习框架,称为 GuidedStyle,通过使用知识网络引导图像生成过程,从而在预训练的 StyleGAN 上实现语义人脸编辑。此外,我们允许 StyleGAN 生成器中的注意力机制自适应地选择单个层进行样式操作。因此,我们的方法能够沿着各种属性(包括微笑、眼镜、性别、胡须、头发颜色和吸引力)进行解耦和可控的编辑。定性和定量的结果都表明,我们的方法在语义人脸编辑方面优于其他竞争方法。此外,我们还表明,我们的模型也可以应用于不同类型的真实和艺术人脸编辑,展示了强大的泛化能力。

相似文献

1
GuidedStyle: Attribute knowledge guided style manipulation for semantic face editing.引导式风格:用于语义人脸编辑的属性知识引导式风格操控。
Neural Netw. 2022 Jan;145:209-220. doi: 10.1016/j.neunet.2021.10.017. Epub 2021 Oct 28.
2
InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs.InterFaceGAN:解释 GAN 学习到的解缠面部表示。
IEEE Trans Pattern Anal Mach Intell. 2022 Apr;44(4):2004-2018. doi: 10.1109/TPAMI.2020.3034267. Epub 2022 Mar 4.
3
Identity preserving multi-pose facial expression recognition using fine tuned VGG on the latent space vector of generative adversarial network.基于生成对抗网络潜在空间向量的微调 VGG 进行身份保留多姿态面部表情识别。
Math Biosci Eng. 2021 Apr 28;18(4):3699-3717. doi: 10.3934/mbe.2021186.
4
SAM-GAN: Self-Attention supporting Multi-stage Generative Adversarial Networks for text-to-image synthesis.SAM-GAN:用于文本到图像合成的支持多阶段生成对抗网络的自注意力模型。
Neural Netw. 2021 Jun;138:57-67. doi: 10.1016/j.neunet.2021.01.023. Epub 2021 Feb 10.
5
Towards Disentangling Latent Space for Unsupervised Semantic Face Editing.面向无监督语义人脸编辑的潜在空间解缠。
IEEE Trans Image Process. 2022;31:1475-1489. doi: 10.1109/TIP.2022.3142527. Epub 2022 Jan 27.
6
IA-FaceS: A bidirectional method for semantic face editing.IA-FaceS:一种用于语义面部编辑的双向方法。
Neural Netw. 2023 Jan;158:272-292. doi: 10.1016/j.neunet.2022.11.016. Epub 2022 Nov 22.
7
GH-Feat: Learning Versatile Generative Hierarchical Features From GANs.GH-Feat:从 GAN 中学习通用生成层次特征。
IEEE Trans Pattern Anal Mach Intell. 2023 Jun;45(6):7395-7411. doi: 10.1109/TPAMI.2022.3225788. Epub 2023 May 5.
8
ShapeEditor: A StyleGAN Encoder for Stable and High Fidelity Face Swapping.ShapeEditor:一种用于稳定且高保真面部交换的StyleGAN编码器。
Front Neurorobot. 2022 Jan 21;15:785808. doi: 10.3389/fnbot.2021.785808. eCollection 2021.
9
A Semantic Segment Encoder (SSE): Improving human face inversion quality through minimized learning space.语义分割编码器 (SSE):通过最小化学习空间来提高人脸反演质量。
PLoS One. 2023 Dec 5;18(12):e0295316. doi: 10.1371/journal.pone.0295316. eCollection 2023.
10
DrawingInStyles: Portrait Image Generation and Editing With Spatially Conditioned StyleGAN.绘画风格:基于空间条件StyleGAN的人像图像生成与编辑
IEEE Trans Vis Comput Graph. 2023 Oct;29(10):4074-4088. doi: 10.1109/TVCG.2022.3178734. Epub 2023 Sep 1.

引用本文的文献

1
Deepfakes as a threat to a speaker and facial recognition: An overview of tools and attack vectors.深度伪造对说话者和面部识别的威胁:工具与攻击途径概述
Heliyon. 2023 Apr 3;9(4):e15090. doi: 10.1016/j.heliyon.2023.e15090. eCollection 2023 Apr.
2
An experimental study of animating-based facial image manipulation in online class environments.基于动画的在线课堂环境中的面部图像操作的实验研究。
Sci Rep. 2023 Mar 22;13(1):4667. doi: 10.1038/s41598-023-31408-y.