Wei Xingxing, Guo Ying, Yu Jie
IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):2711-2725. doi: 10.1109/TPAMI.2022.3176760. Epub 2023 Feb 3.
To assess the vulnerability of deep learning in the physical world, recent works introduce adversarial patches and apply them on different tasks. In this paper, we propose another kind of adversarial patch: the Meaningful Adversarial Sticker, a physically feasible and stealthy attack method by using real stickers existing in our life. Unlike the previous adversarial patches by designing perturbations, our method manipulates the sticker's pasting position and rotation angle on the objects to perform physical attacks. Because the position and rotation angle are less affected by the printing loss and color distortion, adversarial stickers can keep good attacking performance in the physical world. Besides, to make adversarial stickers more practical in real scenes, we conduct attacks in the black-box setting with the limited information rather than the white-box setting with all the details of threat models. To effectively solve for the sticker's parameters, we design the Region based Heuristic Differential Evolution Algorithm, which utilizes the new-found regional aggregation of effective solutions and the adaptive adjustment strategy of the evaluation criteria. Our method is comprehensively verified in the face recognition and then extended to the image retrieval and traffic sign recognition. Extensive experiments show the proposed method is effective and efficient in complex physical conditions and has a good generalization for different tasks.
为了评估深度学习在现实世界中的脆弱性,最近的研究引入了对抗补丁并将其应用于不同任务。在本文中,我们提出了另一种对抗补丁:有意义的对抗贴纸,这是一种通过使用我们生活中现有的真实贴纸进行物理可行且隐秘的攻击方法。与之前通过设计扰动的对抗补丁不同,我们的方法通过操纵贴纸在物体上的粘贴位置和旋转角度来进行物理攻击。由于位置和旋转角度受打印损失和颜色失真的影响较小,对抗贴纸在现实世界中能保持良好的攻击性能。此外,为了使对抗贴纸在实际场景中更实用,我们在信息有限的黑盒设置下进行攻击,而不是在拥有威胁模型所有细节的白盒设置下。为了有效地求解贴纸的参数,我们设计了基于区域的启发式差分进化算法,该算法利用新发现的有效解的区域聚集和评估标准的自适应调整策略。我们的方法在人脸识别中得到了全面验证,然后扩展到图像检索和交通标志识别。大量实验表明,该方法在复杂物理条件下有效且高效,并且对不同任务具有良好的通用性。