Suppr超能文献

使用恒重码对微调模型中的卷积层进行白盒水印处理。

White Box Watermarking for Convolution Layers in Fine-Tuning Model Using the Constant Weight Code.

作者信息

Kuribayashi Minoru, Yasui Tatsuya, Malik Asad

机构信息

Graduate School of Natural Science and Technology, Okayama University, Okayama 700-8530, Japan.

Department of Computer Science, Aligarh Muslim University, Aligarh 202001, India.

出版信息

J Imaging. 2023 Jun 9;9(6):117. doi: 10.3390/jimaging9060117.

Abstract

Deep neural network (DNN) watermarking is a potential approach for protecting the intellectual property rights of DNN models. Similar to classical watermarking techniques for multimedia content, the requirements for DNN watermarking include capacity, robustness, transparency, and other factors. Studies have focused on robustness against retraining and fine-tuning. However, less important neurons in the DNN model may be pruned. Moreover, although the encoding approach renders DNN watermarking robust against pruning attacks, the watermark is assumed to be embedded only into the fully connected layer in the fine-tuning model. In this study, we extended the method such that the model can be applied to any convolution layer of the DNN model and designed a watermark detector based on a statistical analysis of the extracted weight parameters to evaluate whether the model is watermarked. Using a nonfungible token mitigates the overwriting of the watermark and enables checking when the DNN model with the watermark was created.

摘要

深度神经网络(DNN)水印是保护DNN模型知识产权的一种潜在方法。与用于多媒体内容的经典水印技术类似,DNN水印的要求包括容量、鲁棒性、透明度等因素。研究主要集中在针对重新训练和微调的鲁棒性上。然而,DNN模型中不太重要的神经元可能会被修剪。此外,尽管编码方法使DNN水印对剪枝攻击具有鲁棒性,但水印被假定仅嵌入到微调模型的全连接层中。在本研究中,我们扩展了该方法,使其可以应用于DNN模型的任何卷积层,并基于对提取的权重参数的统计分析设计了一个水印检测器,以评估模型是否带有水印。使用不可替代令牌可减轻水印的覆盖,并能够检查带有水印的DNN模型是何时创建的。

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验