Fkirin Alaa, Attiya Gamal, El-Sayed Ayman, Shouman Marwa A
Department of Electrical Engineering, Faculty of Engineering, Fayoum University, Fayoum governorate, Fayoum, Egypt.
Computer Science and Engineering Department, Faculty of Electronic Engineering, Menoufia University, Menoufia governorate, Menouf, Egypt.
Multimed Tools Appl. 2022;81(11):15961-15975. doi: 10.1007/s11042-022-12566-z. Epub 2022 Mar 2.
Nowadays, deep learning achieves higher levels of accuracy than ever before. This evolution makes deep learning crucial for applications that care for safety, like self-driving cars and helps consumers to meet most of their expectations. Further, Deep Neural Networks (DNNs) are powerful approaches that employed to solve several issues. These issues include healthcare, advertising, marketing, computer vision, speech processing, natural language processing. The DNNs have marvelous progress in these different fields, but training such DNN models requires a lot of time, a vast amount of data and in most cases a lot of computational steps. Selling such pre-trained models is a profitable business model. But, sharing them without the owner permission is a serious threat. Unfortunately, once the models are sold, they can be easily copied and redistributed. This paper first presents a review of how digital watermarking technologies are really very helpful in the copyright protection of the DNNs. Then, a comparative study between the latest techniques is presented. Also, several optimizers are proposed to improve the accuracy against the fine-tuning attack. Finally, several experiments are performed with black-box settings using several optimizers and the results are compared with the SGD optimizer.
如今,深度学习实现了比以往更高的准确率。这一发展使得深度学习对于自动驾驶汽车等注重安全性的应用至关重要,并有助于满足消费者的大多数期望。此外,深度神经网络(DNN)是用于解决多个问题的强大方法。这些问题包括医疗保健、广告、营销、计算机视觉、语音处理、自然语言处理。DNN在这些不同领域取得了惊人的进展,但训练此类DNN模型需要大量时间、海量数据,而且在大多数情况下还需要大量计算步骤。出售此类预训练模型是一种盈利的商业模式。但是,未经所有者许可就分享它们是一种严重威胁。不幸的是,一旦模型售出,它们就很容易被复制和重新分发。本文首先综述数字水印技术如何在DNN的版权保护中非常有帮助。然后,对最新技术进行了比较研究。此外,还提出了几种优化器以提高针对微调攻击的准确率。最后,在黑盒设置下使用几种优化器进行了多项实验,并将结果与随机梯度下降(SGD)优化器进行了比较。