Suppr超能文献

关注型 WaveBlock:用于人像重识别及其他领域的无监督域自适应的互补增强互网络

Attentive WaveBlock: Complementarity-Enhanced Mutual Networks for Unsupervised Domain Adaptation in Person Re-Identification and Beyond.

出版信息

IEEE Trans Image Process. 2022;31:1532-1544. doi: 10.1109/TIP.2022.3140614. Epub 2022 Feb 1.

Abstract

Unsupervised domain adaptation (UDA) for person re-identification is challenging because of the huge gap between the source and target domain. A typical self-training method is to use pseudo-labels generated by clustering algorithms to iteratively optimize the model on the target domain. However, a drawback to this is that noisy pseudo-labels generally cause trouble in learning. To address this problem, a mutual learning method by dual networks has been developed to produce reliable soft labels. However, as the two neural networks gradually converge, their complementarity is weakened and they likely become biased towards the same kind of noise. This paper proposes a novel light-weight module, the Attentive WaveBlock (AWB), which can be integrated into the dual networks of mutual learning to enhance the complementarity and further depress noise in the pseudo-labels. Specifically, we first introduce a parameter-free module, the WaveBlock, which creates a difference between features learned by two networks by waving blocks of feature maps differently. Then, an attention mechanism is leveraged to enlarge the difference created and discover more complementary features. Furthermore, two kinds of combination strategies, i.e. pre-attention and post-attention, are explored. Experiments demonstrate that the proposed method achieves state-of-the-art performance with significant improvements on multiple UDA person re-identification tasks. We also prove the generality of the proposed method by applying it to vehicle re-identification and image classification tasks. Our codes and models are available at: AWB.

摘要

无监督领域自适应(UDA)在重新识别人员方面具有挑战性,因为源域和目标域之间存在巨大差距。一种典型的自训练方法是使用聚类算法生成的伪标签,在目标域上迭代优化模型。然而,这样做的一个缺点是,嘈杂的伪标签通常会在学习中造成麻烦。为了解决这个问题,已经开发了一种双网络的相互学习方法,以产生可靠的软标签。然而,随着两个神经网络逐渐收敛,它们的互补性减弱,并且它们可能偏向于相同类型的噪声。本文提出了一种新颖的轻量级模块,即注意力波块(AWB),可以集成到相互学习的双网络中,以增强互补性,并进一步抑制伪标签中的噪声。具体来说,我们首先引入了一个无参数模块,即波块,通过以不同的方式挥动特征图的块来在两个网络学习的特征之间创建差异。然后,利用注意力机制来放大创建的差异并发现更多互补的特征。此外,还探索了两种组合策略,即预注意和后注意。实验表明,该方法在多个 UDA 人员重新识别任务中取得了最先进的性能,并在多个 UDA 人员重新识别任务中取得了显著的改进。我们还通过将其应用于车辆重新识别和图像分类任务来证明了该方法的通用性。我们的代码和模型可在:AWB 获得。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验