IEEE Trans Image Process. 2023;32:2107-2119. doi: 10.1109/TIP.2023.3263112.
Domain generalizable person re-identification (DG ReID) is a challenging problem, because the trained model is often not generalizable to unseen target domains with different distribution from the source training domains. Data augmentation has been verified to be beneficial for better exploiting the source data to improve the model generalization. However, existing approaches primarily rely on pixel-level image generation that requires designing and training an extra generation network, which is extremely complex and provides limited diversity of augmented data. In this paper, we propose a simple yet effective feature based augmentation technique, named Style-uncertainty Augmentation (SuA). The main idea of SuA is to randomize the style of training data by perturbing the instance style with Gaussian noise during training process to increase the training domain diversity. And to better generalize knowledge across these augmented domains, we propose a progressive learning to learn strategy named Self-paced Meta Learning (SpML) that extends the conventional one-stage meta learning to multi-stage training process. The rationality is to gradually improve the model generalization ability to unseen target domains by simulating the mechanism of human learning. Furthermore, conventional person Re-ID loss functions are unable to leverage the valuable domain information to improve the model generalization. So we further propose a distance-graph alignment loss that aligns the feature relationship distribution among domains to facilitate the network to explore domain-invariant representations of images. Extensive experiments on four large-scale benchmarks demonstrate that our SuA-SpML achieves state-of-the-art generalization to unseen domains for person ReID.
域泛化的行人再识别(DG ReID)是一个具有挑战性的问题,因为训练的模型通常不能泛化到与源训练域具有不同分布的未见目标域。数据增强已被证明有利于更好地利用源数据来提高模型的泛化能力。然而,现有的方法主要依赖于像素级别的图像生成,这需要设计和训练一个额外的生成网络,这是极其复杂的,并且提供的增强数据的多样性有限。在本文中,我们提出了一种简单而有效的基于特征的增强技术,名为 Style-uncertainty Augmentation(SuA)。SuA 的主要思想是通过在训练过程中用高斯噪声扰动实例样式来随机化训练数据的样式,从而增加训练域的多样性。为了更好地在这些增强的域之间泛化知识,我们提出了一种名为 Self-paced Meta Learning(SpML)的渐进式学习策略,该策略将传统的单阶段元学习扩展到多阶段训练过程。其合理性是通过模拟人类学习的机制,逐步提高模型对未见目标域的泛化能力。此外,传统的行人 Re-ID 损失函数无法利用有价值的域信息来提高模型的泛化能力。因此,我们进一步提出了一种距离图对齐损失,该损失对齐了域间特征关系分布,以帮助网络探索图像的域不变表示。在四个大规模基准上的广泛实验表明,我们的 SuA-SpML 实现了行人 ReID 领域的最新泛化。