Yang Fengxiang, Weng Juanjuan, Zhong Zhun, Liu Hong, Wang Zheng, Luo Zhiming, Cao Donglin, Li Shaozi, Satoh Shin'ichi, Sebe Nicu
IEEE Trans Pattern Anal Mach Intell. 2023 Apr;45(4):5218-5235. doi: 10.1109/TPAMI.2022.3199013. Epub 2023 Mar 7.
Recent studies show that deep person re-identification (re-ID) models are vulnerable to adversarial examples, so it is critical to improving the robustness of re-ID models against attacks. To achieve this goal, we explore the strengths and weaknesses of existing re-ID models, i.e., designing learning-based attacks and training robust models by defending against the learned attacks. The contributions of this paper are three-fold: First, we build a holistic attack-defense framework to study the relationship between the attack and defense for person re-ID. Second, we introduce a combinatorial adversarial attack that is adaptive to unseen domains and unseen model types. It consists of distortions in pixel and color space (i.e., mimicking camera shifts). Third, we propose a novel virtual-guided meta-learning algorithm for our attack-defense system. We leverage a virtual dataset to conduct experiments under our meta-learning framework, which can explore the cross-domain constraints for enhancing the generalization of the attack and the robustness of the re-ID model. Comprehensive experiments on three large-scale re-ID benchmarks demonstrate that: 1) Our combinatorial attack is effective and highly universal in cross-model and cross-dataset scenarios; 2) Our meta-learning algorithm can be readily applied to different attack and defense approaches, which can reach consistent improvement; 3) The defense model trained on the learning-to-learn framework is robust to recent SOTA attacks that are not even used during training.
最近的研究表明,深度行人重识别(re-ID)模型容易受到对抗样本的影响,因此提高re-ID模型对攻击的鲁棒性至关重要。为了实现这一目标,我们探究了现有re-ID模型的优缺点,即设计基于学习的攻击,并通过抵御学习到的攻击来训练鲁棒模型。本文的贡献主要有三点:第一,我们构建了一个整体的攻防框架来研究行人re-ID攻击与防御之间的关系。第二,我们引入了一种组合对抗攻击,它适用于未见领域和未见模型类型。它由像素和颜色空间中的失真组成(即模拟相机移动)。第三,我们为我们的攻防系统提出了一种新颖的虚拟引导元学习算法。我们利用一个虚拟数据集在我们的元学习框架下进行实验,该框架可以探索跨域约束,以增强攻击的泛化能力和re-ID模型的鲁棒性。在三个大规模re-ID基准上的综合实验表明:1)我们的组合攻击在跨模型和跨数据集场景中是有效且高度通用的;2)我们的元学习算法可以很容易地应用于不同的攻防方法,并且可以实现一致的改进;3)在学习学习框架上训练的防御模型对最近在训练期间甚至未使用的最先进攻击具有鲁棒性。