• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用稳健深度学习的高效深度伪造视频检测

An efficient deepfake video detection using robust deep learning.

作者信息

Qadir Abdul, Mahum Rabbia, El-Meligy Mohammed A, Ragab Adham E, AlSalman Abdulmalik, Awais Muhammad

机构信息

Computer Science Department, UET, Taxila, Pakistan.

Advanced Manufacturing Institute, King Saud University, Riyadh, 11421, Saudi Arabia.

出版信息

Heliyon. 2024 Feb 9;10(5):e25757. doi: 10.1016/j.heliyon.2024.e25757. eCollection 2024 Mar 15.

DOI:10.1016/j.heliyon.2024.e25757
PMID:38434385
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10907530/
Abstract

The creation and manipulation of synthetic images have evolved rapidly, causing serious concerns about their effects on society. Although there have been various attempts to identify deep fake videos, these approaches are not universal. Identifying these misleading deepfakes is the first step in preventing them from spreading on social media sites. We introduce a unique deep-learning technique to identify fraudulent clips. Most deepfake identifiers currently focus on identifying face exchange, lip synchronous, expression modification, puppeteers, and other factors. However, exploring a consistent basis for all forms of fake videos and images in real-time forensics is challenging. We propose a hybrid technique that takes input from videos of successive targeted frames, then feeds these frames to the ResNet-Swish-BiLSTM, an optimized convolutional BiLSTM-based residual network for training and classification. This proposed method helps identify artifacts in deepfake images that do not seem real. To assess the robustness of our proposed model, we used the open deepfake detection challenge dataset (DFDC) and Face Forensics deepfake collections (FF++). We achieved 96.23% accuracy when using the FF++ digital record. In contrast, we attained 78.33% accuracy using the aggregated records from FF++ and DFDC. We performed extensive experiments and believe that our proposed method provides more significant results than existing techniques.

摘要

合成图像的创建和处理发展迅速,引发了人们对其对社会影响的严重担忧。尽管已经有各种尝试来识别深度伪造视频,但这些方法并不通用。识别这些具有误导性的深度伪造内容是防止它们在社交媒体网站上传播的第一步。我们引入了一种独特的深度学习技术来识别欺诈性片段。目前大多数深度伪造识别器专注于识别面部交换、唇同步、表情修改、操纵者等因素。然而,在实时取证中为所有形式的虚假视频和图像探索一个一致的基础具有挑战性。我们提出了一种混合技术,该技术从连续目标帧的视频中获取输入,然后将这些帧输入到ResNet-Swish-BiLSTM中,这是一个基于卷积BiLSTM的优化残差网络,用于训练和分类。我们提出的方法有助于识别深度伪造图像中看起来不真实的伪像。为了评估我们提出的模型的鲁棒性,我们使用了开放的深度伪造检测挑战数据集(DFDC)和面部取证深度伪造数据集(FF++)。使用FF++数字记录时,我们达到了96.23%的准确率。相比之下,使用FF++和DFDC的汇总记录时,我们达到了78.33%的准确率。我们进行了广泛的实验,并相信我们提出的方法比现有技术提供了更显著的结果。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/eaca1227d53b/gr12.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/097c22349dbf/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/f8c422cf6af1/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/41ce8648629f/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/2b68ad2844c3/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/b9e84327e51b/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/2e36b6dc29dc/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/881730002bf3/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/e9ece368f8b5/gr8.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/0c3fe288e2d2/gr9.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/ad13268d5d60/gr10.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/6ccf01857e19/gr11.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/eaca1227d53b/gr12.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/097c22349dbf/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/f8c422cf6af1/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/41ce8648629f/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/2b68ad2844c3/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/b9e84327e51b/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/2e36b6dc29dc/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/881730002bf3/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/e9ece368f8b5/gr8.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/0c3fe288e2d2/gr9.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/ad13268d5d60/gr10.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/6ccf01857e19/gr11.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e7ed/10907530/eaca1227d53b/gr12.jpg

相似文献

1
An efficient deepfake video detection using robust deep learning.使用稳健深度学习的高效深度伪造视频检测
Heliyon. 2024 Feb 9;10(5):e25757. doi: 10.1016/j.heliyon.2024.e25757. eCollection 2024 Mar 15.
2
Deepfake forensics analysis: An explainable hierarchical ensemble of weakly supervised models.深度伪造取证分析:一种弱监督模型的可解释分层集成
Forensic Sci Int Synerg. 2022 Jan 27;4:100217. doi: 10.1016/j.fsisyn.2022.100217. eCollection 2022.
3
A Review of Image Processing Techniques for Deepfakes.深度伪造的图像处理技术综述。
Sensors (Basel). 2022 Jun 16;22(12):4556. doi: 10.3390/s22124556.
4
Deepfake attack prevention using steganography GANs.使用隐写术生成对抗网络防止深度伪造攻击
PeerJ Comput Sci. 2022 Oct 20;8:e1125. doi: 10.7717/peerj-cs.1125. eCollection 2022.
5
A Robust Approach to Multimodal Deepfake Detection.一种用于多模态深度伪造检测的稳健方法。
J Imaging. 2023 Jun 19;9(6):122. doi: 10.3390/jimaging9060122.
6
Exposing Manipulated Photos and Videos in Digital Forensics Analysis.数字取证分析中揭露经过处理的照片和视频
J Imaging. 2021 Jun 24;7(7):102. doi: 10.3390/jimaging7070102.
7
The Face Deepfake Detection Challenge.面部深度伪造检测挑战赛。
J Imaging. 2022 Sep 28;8(10):263. doi: 10.3390/jimaging8100263.
8
Deepfakes Generation and Detection: A Short Survey.深度伪造的生成与检测:简要综述
J Imaging. 2023 Jan 13;9(1):18. doi: 10.3390/jimaging9010018.
9
A forensic evaluation method for DeepFake detection using DCNN-based facial similarity scores.基于 DCNN 的面部相似度分数的 DeepFake 检测法医评估方法。
Forensic Sci Int. 2024 May;358:111747. doi: 10.1016/j.forsciint.2023.111747. Epub 2023 Jun 3.
10
On the Generalization of Deep Learning Models in Video Deepfake Detection.关于深度学习模型在视频深度伪造检测中的泛化
J Imaging. 2023 Apr 29;9(5):89. doi: 10.3390/jimaging9050089.

引用本文的文献

1
Design and development of an efficient RLNet prediction model for deepfake video detection.用于深度伪造视频检测的高效RLNet预测模型的设计与开发。
Front Big Data. 2025 Jul 9;8:1569147. doi: 10.3389/fdata.2025.1569147. eCollection 2025.
2
OpenAI's Sora and Google's Veo 2 in Action: A Narrative Review of Artificial Intelligence-driven Video Generation Models Transforming Healthcare.OpenAI的Sora和谷歌的Veo 2的实际应用:对改变医疗保健的人工智能驱动视频生成模型的叙述性综述
Cureus. 2025 Jan 17;17(1):e77593. doi: 10.7759/cureus.77593. eCollection 2025 Jan.

本文引用的文献

1
Learning Patch-Channel Correspondence for Interpretable Face Forgery Detection.学习用于可解释面部伪造检测的面片-通道对应关系
IEEE Trans Image Process. 2023;32:1668-1680. doi: 10.1109/TIP.2023.3246793. Epub 2023 Mar 6.
2
Skin Lesion Detection Using Hand-Crafted and DL-Based Features Fusion and LSTM.基于手工特征与深度学习特征融合及长短期记忆网络的皮肤病变检测
Diagnostics (Basel). 2022 Nov 28;12(12):2974. doi: 10.3390/diagnostics12122974.
3
Emergence of Deep Learning in Knee Osteoarthritis Diagnosis.深度学习在膝关节骨关节炎诊断中的应用
Comput Intell Neurosci. 2021 Nov 10;2021:4931437. doi: 10.1155/2021/4931437. eCollection 2021.
4
DeepFake Detection Based on Discrepancies Between Faces and Their Context.基于人脸与其上下文差异的深度伪造检测。
IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):6111-6121. doi: 10.1109/TPAMI.2021.3093446. Epub 2022 Sep 14.
5
Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network.通过高效神经网络实现COVID-19的自动化医学诊断。
Appl Soft Comput. 2020 Nov;96:106691. doi: 10.1016/j.asoc.2020.106691. Epub 2020 Aug 29.
6
A Novel Counterfeit Feature Extraction Technique for Exposing Face-Swap Images Based on Deep Learning and Error Level Analysis.一种基于深度学习和错误级别分析的用于揭露面部交换图像的新型伪造特征提取技术。
Entropy (Basel). 2020 Feb 21;22(2):249. doi: 10.3390/e22020249.
7
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals.FakeCatcher:利用生物信号检测合成人像视频
IEEE Trans Pattern Anal Mach Intell. 2020 Jul 15;PP. doi: 10.1109/TPAMI.2020.3009287.