• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

HCGAN:用于无配对草图面部合成的分层对比生成对抗网络

HCGAN: hierarchical contrast generative adversarial network for unpaired sketch face synthesis.

作者信息

Du Kangning, Wang Zhen, Cao Lin, Guo Yanan, Tian Shu, Zhang Fan

机构信息

School of Information and Communication Engineering, Beijing Information Science and Technology University, Key Laboratory of Information and Communication Systems, Ministry of Information Industry, Beijing, China.

出版信息

PeerJ Comput Sci. 2024 Jul 31;10:e2184. doi: 10.7717/peerj-cs.2184. eCollection 2024.

DOI:10.7717/peerj-cs.2184
PMID:39145238
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11322990/
Abstract

Transforming optical facial images into sketches while preserving realism and facial features poses a significant challenge. The current methods that rely on paired training data are costly and resource-intensive. Furthermore, they often fail to capture the intricate features of faces, resulting in substandard sketch generation. To address these challenges, we propose the novel hierarchical contrast generative adversarial network (HCGAN). Firstly, HCGAN consists of a global sketch synthesis module that generates sketches with well-defined global features and a local sketch refinement module that enhances the ability to extract features in critical areas. Secondly, we introduce local refinement loss based on the local sketch refinement module, refining sketches at a granular level. Finally, we propose an association strategy called "warmup-epoch" and local consistency loss between the two modules to ensure HCGAN is effectively optimized. Evaluations of the CUFS and SKSF-A datasets demonstrate that our method produces high-quality sketches and outperforms existing state-of-the-art methods in terms of fidelity and realism. Compared to the current state-of-the-art methods, HCGAN reduces FID by 12.6941, 4.9124, and 9.0316 on three datasets of CUFS, respectively, and by 7.4679 on the SKSF-A dataset. Additionally, it obtained optimal scores for content fidelity (CF), global effects (GE), and local patterns (LP). The proposed HCGAN model provides a promising solution for realistic sketch synthesis under unpaired data training.

摘要

将光学面部图像转换为草图,同时保留真实感和面部特征,这是一项重大挑战。当前依赖配对训练数据的方法成本高昂且资源密集。此外,它们往往无法捕捉面部的复杂特征,导致草图生成质量不高。为应对这些挑战,我们提出了新颖的分层对比生成对抗网络(HCGAN)。首先,HCGAN由一个生成具有明确全局特征草图的全局草图合成模块和一个增强关键区域特征提取能力的局部草图细化模块组成。其次,我们基于局部草图细化模块引入局部细化损失,在细粒度级别上细化草图。最后,我们提出一种名为“热身轮次”的关联策略以及两个模块之间的局部一致性损失,以确保HCGAN得到有效优化。对CUFS和SKSF - A数据集的评估表明,我们的方法生成了高质量的草图,并且在逼真度和真实感方面优于现有的最先进方法。与当前的最先进方法相比,HCGAN在CUFS的三个数据集上分别将FID降低了12.6941、4.9124和9.0316,在SKSF - A数据集上降低了7.4679。此外,它在内容逼真度(CF)、全局效果(GE)和局部图案(LP)方面获得了最优分数。所提出的HCGAN模型为未配对数据训练下的逼真草图合成提供了一个有前景的解决方案。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/6a1560e8348f/peerj-cs-10-2184-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/2dd019c22a37/peerj-cs-10-2184-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/20c9c7f2e763/peerj-cs-10-2184-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/c40c3bd80333/peerj-cs-10-2184-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/805f057d5002/peerj-cs-10-2184-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/074b75038a0b/peerj-cs-10-2184-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/d610683a8664/peerj-cs-10-2184-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/6a1560e8348f/peerj-cs-10-2184-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/2dd019c22a37/peerj-cs-10-2184-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/20c9c7f2e763/peerj-cs-10-2184-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/c40c3bd80333/peerj-cs-10-2184-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/805f057d5002/peerj-cs-10-2184-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/074b75038a0b/peerj-cs-10-2184-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/d610683a8664/peerj-cs-10-2184-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/151d/11322990/6a1560e8348f/peerj-cs-10-2184-g007.jpg

相似文献

1
HCGAN: hierarchical contrast generative adversarial network for unpaired sketch face synthesis.HCGAN:用于无配对草图面部合成的分层对比生成对抗网络
PeerJ Comput Sci. 2024 Jul 31;10:e2184. doi: 10.7717/peerj-cs.2184. eCollection 2024.
2
Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network With Graph Representation Learning.基于语义驱动生成对抗网络与图表示学习的双相面部照片-素描合成
IEEE Trans Neural Netw Learn Syst. 2025 Feb;36(2):2182-2195. doi: 10.1109/TNNLS.2023.3341246. Epub 2025 Feb 6.
3
Toward Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs.通过构图辅助的 GAN 实现逼真的人脸照片素描合成。
IEEE Trans Cybern. 2021 Sep;51(9):4350-4362. doi: 10.1109/TCYB.2020.2972944. Epub 2021 Sep 15.
4
Multi-Level Cycle-Consistent Adversarial Networks with Attention Mechanism for Face Sketch-Photo Synthesis.基于注意力机制的多层次循环一致性对抗网络的人脸素描-照片合成。
Sensors (Basel). 2022 Sep 6;22(18):6725. doi: 10.3390/s22186725.
5
Face Sketch Synthesis by Multidomain Adversarial Learning.基于多域对抗学习的面部草图合成
IEEE Trans Neural Netw Learn Syst. 2019 May;30(5):1419-1428. doi: 10.1109/TNNLS.2018.2869574. Epub 2018 Oct 1.
6
Facial Sketch Synthesis Using 2D Direct Combined Model-Based Face-Specific Markov Network.基于二维直接组合模型的人脸特定马尔可夫网络的人脸素描合成。
IEEE Trans Image Process. 2016 Aug;25(8):3546-61. doi: 10.1109/TIP.2016.2570571. Epub 2016 May 20.
7
Bionic Face Sketch Generator.仿生人脸草图生成器。
IEEE Trans Cybern. 2020 Jun;50(6):2701-2714. doi: 10.1109/TCYB.2019.2924589. Epub 2019 Jul 16.
8
HiFiSketch: High Fidelity Face Photo-Sketch Synthesis and Manipulation.HiFiSketch:高保真面部照片-素描合成与操控
IEEE Trans Image Process. 2023;32:5865-5876. doi: 10.1109/TIP.2023.3326680. Epub 2023 Nov 3.
9
Face image-sketch synthesis via generative adversarial fusion.通过生成对抗融合实现面部图像-草图合成
Neural Netw. 2022 Oct;154:179-189. doi: 10.1016/j.neunet.2022.07.013. Epub 2022 Jul 16.
10
Controllable Sketch-to-Image Translation for Robust Face Synthesis.用于稳健面部合成的可控草图到图像翻译
IEEE Trans Image Process. 2021;30:8797-8810. doi: 10.1109/TIP.2021.3120669. Epub 2021 Oct 27.

本文引用的文献

1
Unpaired Artistic Portrait Style Transfer via Asymmetric Double-Stream GAN.通过非对称双流生成对抗网络实现非配对艺术肖像风格迁移
IEEE Trans Neural Netw Learn Syst. 2023 Sep;34(9):5427-5439. doi: 10.1109/TNNLS.2023.3263846. Epub 2023 Sep 1.
2
PMSGAN: Parallel Multistage GANs for Face Image Translation.PMSGAN:用于面部图像翻译的并行多级生成对抗网络
IEEE Trans Neural Netw Learn Syst. 2024 Jul;35(7):9352-9365. doi: 10.1109/TNNLS.2022.3233025. Epub 2024 Jul 8.
3
Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation.
用于图像到图像翻译的互补、异构和对抗网络。
IEEE Trans Image Process. 2021;30:3487-3498. doi: 10.1109/TIP.2021.3061286. Epub 2021 Mar 11.
4
Coarse-to-fine classification for diabetic retinopathy grading using convolutional neural network.使用卷积神经网络进行糖尿病视网膜病变分级的粗到细分类。
Artif Intell Med. 2020 Aug;108:101936. doi: 10.1016/j.artmed.2020.101936. Epub 2020 Jul 24.
5
Line Drawings for Face Portraits From Photos Using Global and Local Structure Based GANs.基于全局和局部结构的生成对抗网络的照片人脸肖像线图绘制。
IEEE Trans Pattern Anal Mach Intell. 2021 Oct;43(10):3462-3475. doi: 10.1109/TPAMI.2020.2987931. Epub 2021 Sep 2.
6
Toward Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs.通过构图辅助的 GAN 实现逼真的人脸照片素描合成。
IEEE Trans Cybern. 2021 Sep;51(9):4350-4362. doi: 10.1109/TCYB.2020.2972944. Epub 2021 Sep 15.
7
Face Sketch Synthesis by Multidomain Adversarial Learning.基于多域对抗学习的面部草图合成
IEEE Trans Neural Netw Learn Syst. 2019 May;30(5):1419-1428. doi: 10.1109/TNNLS.2018.2869574. Epub 2018 Oct 1.
8
Transductive face sketch-photo synthesis.传导人脸素描-照片合成。
IEEE Trans Neural Netw Learn Syst. 2013 Sep;24(9):1364-76. doi: 10.1109/TNNLS.2013.2258174.
9
Face photo-sketch synthesis and recognition.面部照片-素描合成与识别。
IEEE Trans Pattern Anal Mach Intell. 2009 Nov;31(11):1955-67. doi: 10.1109/TPAMI.2008.222.