• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

通过注意力机制和年龄感知训练优化CycleGAN以生成逼真的深度伪造图像。

Refining CycleGAN with attention mechanisms and age-Aware training for realistic Deepfakes.

作者信息

Cheng Xi

机构信息

School of Health Caring Industry, Sichuan University of Arts and Science, Dazhou, Sichuan, 635000, China.

出版信息

Heliyon. 2024 Aug 22;10(16):e36665. doi: 10.1016/j.heliyon.2024.e36665. eCollection 2024 Aug 30.

DOI:10.1016/j.heliyon.2024.e36665
PMID:39262956
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11388650/
Abstract

In the evolving landscape of deep learning technologies, the emergence of Deepfakes and synthetic media is becoming increasingly prominent within digital media production. This research addresses the limitations inherent in existing face image generation algorithms based on Generative Adversarial Networks (GAN), particularly the challenges of domain irrelevancy and inadequate facial detail representation. The study introduces an enhanced face image generation algorithm, aiming to refine the CycleGAN framework. The enhancement involves a two-fold strategy: firstly, the generator's architecture is refined through the integration of an attention mechanism and adaptive residual blocks, enabling the extraction of more nuanced facial features. Secondly, the discriminator's accuracy in distinguishing real from synthetic images is improved by incorporating a relative loss concept into the loss function. Additionally, this study presents a novel model training approach that incorporates age constraints, thereby mitigating the effects of age variations on the synthesized images. The effectiveness of the proposed algorithm is empirically validated through comparative analysis with existing methodologies, utilizing the CelebA dataset. The results demonstrate that the proposed algorithm significantly enhances the realism of generated face images, outperforming current methods in terms of Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM), while also achieving notable improvements in subjective visual quality. The implementation of this advanced method is anticipated to substantially elevate the efficiency and quality of digital media production, contributing positively to the broader field of digital media creation.

摘要

在深度学习技术不断发展的背景下,深度伪造和合成媒体在数字媒体制作中日益突出。本研究针对基于生成对抗网络(GAN)的现有面部图像生成算法所固有的局限性,特别是领域不相关性和面部细节表示不足的挑战。该研究引入了一种增强的面部图像生成算法,旨在改进循环生成对抗网络(CycleGAN)框架。这种增强涉及双重策略:首先,通过集成注意力机制和自适应残差块来改进生成器的架构,从而能够提取更细微的面部特征。其次,通过将相对损失概念纳入损失函数来提高判别器区分真实图像和合成图像的准确性。此外,本研究提出了一种结合年龄约束的新型模型训练方法,从而减轻年龄变化对合成图像的影响。通过使用CelebA数据集与现有方法进行对比分析,对所提算法的有效性进行了实证验证。结果表明,所提算法显著提高了生成面部图像的真实感,在峰值信噪比(PSNR)和结构相似性指数测量(SSIM)方面优于当前方法,同时在主观视觉质量上也有显著提升。预计这种先进方法的实施将大幅提高数字媒体制作的效率和质量,为数字媒体创作的更广泛领域做出积极贡献。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b966abf31adb/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b7bb6271dee1/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/22bfad2d6cd6/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/06e2b07c385a/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/3268858fbc79/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/3d064fcdf332/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b3017194c3cb/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b966abf31adb/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b7bb6271dee1/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/22bfad2d6cd6/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/06e2b07c385a/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/3268858fbc79/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/3d064fcdf332/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b3017194c3cb/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a55c/11388650/b966abf31adb/gr7.jpg

相似文献

1
Refining CycleGAN with attention mechanisms and age-Aware training for realistic Deepfakes.通过注意力机制和年龄感知训练优化CycleGAN以生成逼真的深度伪造图像。
Heliyon. 2024 Aug 22;10(16):e36665. doi: 10.1016/j.heliyon.2024.e36665. eCollection 2024 Aug 30.
2
Compensation cycle consistent generative adversarial networks (Comp-GAN) for synthetic CT generation from MR scans with truncated anatomy.基于截断解剖的磁共振成像到 CT 合成的补偿循环一致生成对抗网络(Comp-GAN)。
Med Phys. 2023 Jul;50(7):4399-4414. doi: 10.1002/mp.16246. Epub 2023 Feb 4.
3
Ultrasound image denoising using generative adversarial networks with residual dense connectivity and weighted joint loss.使用具有残差密集连接和加权联合损失的生成对抗网络进行超声图像去噪
PeerJ Comput Sci. 2022 Feb 16;8:e873. doi: 10.7717/peerj-cs.873. eCollection 2022.
4
Deepfakes in Ophthalmology: Applications and Realism of Synthetic Retinal Images from Generative Adversarial Networks.眼科中的深度伪造技术:生成对抗网络合成视网膜图像的应用与逼真度
Ophthalmol Sci. 2021 Nov 16;1(4):100079. doi: 10.1016/j.xops.2021.100079. eCollection 2021 Dec.
5
Visual resource extraction and artistic communication model design based on improved CycleGAN algorithm.基于改进循环生成对抗网络(CycleGAN)算法的视觉资源提取与艺术传播模型设计
PeerJ Comput Sci. 2024 Mar 18;10:e1889. doi: 10.7717/peerj-cs.1889. eCollection 2024.
6
Generation of Conventional F-FDG PET Images from F-Florbetaben PET Images Using Generative Adversarial Network: A Preliminary Study Using ADNI Dataset.基于 ADNI 数据集的使用生成对抗网络从 F-Florbetaben PET 图像生成常规 F-FDG PET 图像:初步研究
Medicina (Kaunas). 2023 Jul 10;59(7):1281. doi: 10.3390/medicina59071281.
7
A medical image classification method based on self-regularized adversarial learning.基于自正则化对抗学习的医学图像分类方法。
Med Phys. 2024 Nov;51(11):8232-8246. doi: 10.1002/mp.17320. Epub 2024 Jul 30.
8
Improving synthetic media generation and detection using generative adversarial networks.使用生成对抗网络改进合成媒体生成与检测
PeerJ Comput Sci. 2024 Sep 20;10:e2181. doi: 10.7717/peerj-cs.2181. eCollection 2024.
9
Improvement of megavoltage computed tomography image quality for adaptive helical tomotherapy using cycleGAN-based image synthesis with small datasets.利用基于循环生成对抗网络的小数据集图像合成技术提高自适应螺旋断层放疗的兆伏级计算机断层摄影图像质量。
Med Phys. 2021 Oct;48(10):5593-5610. doi: 10.1002/mp.15182. Epub 2021 Aug 30.
10
Weakly supervised low-dose computed tomography denoising based on generative adversarial networks.基于生成对抗网络的弱监督低剂量计算机断层扫描去噪
Quant Imaging Med Surg. 2024 Aug 1;14(8):5571-5590. doi: 10.21037/qims-24-68. Epub 2024 Jul 26.

本文引用的文献

1
Learning Disentangled Representation for One-Shot Progressive Face Swapping.用于一次性渐进式面部交换的学习解缠表示
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):8348-8364. doi: 10.1109/TPAMI.2024.3404334. Epub 2024 Nov 6.
2
DapNet-HLA: Adaptive dual-attention mechanism network based on deep learning to predict non-classical HLA binding sites.DapNet-HLA:基于深度学习的自适应双注意力机制网络,用于预测非经典HLA结合位点。
Anal Biochem. 2023 Apr 1;666:115075. doi: 10.1016/j.ab.2023.115075. Epub 2023 Feb 3.
3
Deepfakes Generation and Detection: A Short Survey.
深度伪造的生成与检测:简要综述
J Imaging. 2023 Jan 13;9(1):18. doi: 10.3390/jimaging9010018.
4
How Can Research on Artificial Empathy Be Enhanced by Applying Deepfakes?如何通过应用深度伪造技术来加强对人工同理心的研究?
J Med Internet Res. 2022 Mar 4;24(3):e29506. doi: 10.2196/29506.
5
Pix2pix Conditional Generative Adversarial Networks for Scheimpflug Camera Color-Coded Corneal Tomography Image Generation.基于 Pix2pix 的条件生成对抗网络的 Scheimpflug 彩色角膜断层成像图生成。
Transl Vis Sci Technol. 2021 Jun 1;10(7):21. doi: 10.1167/tvst.10.7.21.
6
Line Drawings for Face Portraits From Photos Using Global and Local Structure Based GANs.基于全局和局部结构的生成对抗网络的照片人脸肖像线图绘制。
IEEE Trans Pattern Anal Mach Intell. 2021 Oct;43(10):3462-3475. doi: 10.1109/TPAMI.2020.2987931. Epub 2021 Sep 2.
7
A Style-Based Generator Architecture for Generative Adversarial Networks.基于风格的生成对抗网络生成器架构。
IEEE Trans Pattern Anal Mach Intell. 2021 Dec;43(12):4217-4228. doi: 10.1109/TPAMI.2020.2970919. Epub 2021 Nov 3.
8
Image generation by GAN and style transfer for agar plate image segmentation.基于 GAN 和风格迁移的琼脂平板图像分割的图像生成。
Comput Methods Programs Biomed. 2020 Feb;184:105268. doi: 10.1016/j.cmpb.2019.105268. Epub 2019 Dec 17.
9
Paired cycle-GAN-based image correction for quantitative cone-beam computed tomography.基于对偶循环生成对抗网络的定量锥形束计算机断层扫描图像校正。
Med Phys. 2019 Sep;46(9):3998-4009. doi: 10.1002/mp.13656. Epub 2019 Jul 17.