Ding Hongwei, Chen Leiyang, Tao Qi, Fu Zhongwang, Dong Liang, Cui Xiaohui
School of Cyber Science and Engineering, Wuhan University, Wuhan, China.
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, Wuhan, China.
Neural Comput Appl. 2023;35(7):5015-5031. doi: 10.1007/s00521-021-06329-4. Epub 2021 Aug 12.
The detection and location of image splicing forgery are a challenging task in the field of image forensics. It is to study whether an image contains a suspicious tampered area pasted from another image. In this paper, we propose a new image tamper location method based on dual-channel U-Net, that is, DCU-Net. The detection framework based on DCU-Net is mainly divided into three parts: encoder, feature fusion, and decoder. Firstly, high-pass filters are used to extract the residual of the tampered image and generate the residual image, which contains the edge information of the tampered area. Secondly, a dual-channel encoding network model is constructed. The input of the model is the original tampered image and the tampered residual image. Then, the deep features extracted from the dual-channel encoding network are fused for the first time, and then the tampered features with different granularity are extracted by dilation convolution, and then, the secondary fusion is carried out. Finally, the fused feature map is input into the decoder, and the predicted image is decoded layer by layer. The experimental results on Casia2.0 and Columbia datasets show that DCU-Net performs better than the latest algorithm and can accurately locate tampered areas. In addition, the attack experiments show that DCU-Net model has good robustness and can resist noise and JPEG recompression attacks.
图像拼接伪造的检测与定位是图像取证领域一项具有挑战性的任务。其目的是研究一幅图像是否包含从另一幅图像粘贴过来的可疑篡改区域。在本文中,我们提出了一种基于双通道U-Net的新型图像篡改定位方法,即DCU-Net。基于DCU-Net的检测框架主要分为三个部分:编码器、特征融合和解码器。首先,使用高通滤波器提取篡改图像的残差并生成残差图像,该残差图像包含篡改区域的边缘信息。其次,构建一个双通道编码网络模型。该模型的输入是原始篡改图像和篡改残差图像。然后,对从双通道编码网络提取的深度特征进行首次融合,接着通过空洞卷积提取不同粒度的篡改特征,再进行二次融合。最后,将融合后的特征图输入解码器,逐层解码得到预测图像。在Casia2.0和哥伦比亚数据集上的实验结果表明,DCU-Net的性能优于最新算法,能够准确地定位篡改区域。此外,攻击实验表明,DCU-Net模型具有良好的鲁棒性,能够抵抗噪声和JPEG重压缩攻击。