Institute for Quantum Information & State Key Laboratory of High Performance Computing, College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China.
Institute for Quantum Information & State Key Laboratory of High Performance Computing, College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China.
Neural Netw. 2022 Oct;154:521-537. doi: 10.1016/j.neunet.2022.06.017. Epub 2022 Jun 16.
How to obtain good retrieval performance in the case of few-shot labeled samples is the current research focus of Person Re-Identification. To facilitate formal analysis, we formally put forward the concept of Pseudo-Supervised Learning (PSL) to represent a series of research works based on label generation under few-shot condition. Through extensive investigations, we find that the main problem that needs to be solved of PSL is how we can improve the quality of pseudo-label. To solve this problem, in this work, we proposed a simple yet effective Heterogeneous Pseudo-Supervised Learning (H-PSL) framework based on classical PSL to implement asynchronous match, which boosts the feature expression and then a better label prediction in the following. Specifically, a novel isomer is constructed as the feature extractor and is trained with a much larger amount of pseudo-supervised data, i.e., samples with pseudo-labels. In this way, the isomer obtains advanced feature expression. We then deliberately implement a cross-level asynchronous match mechanism between model and pseudo-supervised data. As a result, the quality of pseudo-label is greatly improved and the feature expression performance also be optimized accordingly. In addition, to make better use of pseudo-supervised data, we also designed a knowledge fusion strategy to integrate the pseudo labels and their confidence which are easily obtained by the base model and isomer. Encouragingly, knowledge fusion strategy further removes the noise-labeled samples from candidate data. We conduct experiments on four popular datasets to fully verify the universality of the proposed method. The experimental results show that the proposed method improves the performance of all compared baseline works.
如何在少数标记样本的情况下获得良好的检索性能是当前人物重识别的研究重点。为了便于正式分析,我们正式提出了伪监督学习(PSL)的概念,以表示一系列基于少数条件下生成标签的研究工作。通过广泛的调查,我们发现 PSL 需要解决的主要问题是如何提高伪标签的质量。为了解决这个问题,在这项工作中,我们提出了一个简单而有效的基于经典 PSL 的异构伪监督学习(H-PSL)框架,以实现异步匹配,从而提高特征表达能力,进而在后续步骤中实现更好的标签预测。具体来说,我们构建了一个新颖的异构体作为特征提取器,并使用大量的伪监督数据(即带有伪标签的样本)进行训练。通过这种方式,异构体获得了先进的特征表达能力。然后,我们故意在模型和伪监督数据之间实现跨层次的异步匹配机制。结果,伪标签的质量得到了极大的提高,特征表达性能也得到了相应的优化。此外,为了更好地利用伪监督数据,我们还设计了一种知识融合策略,将基础模型和异构体容易获得的伪标签及其置信度进行融合。令人鼓舞的是,知识融合策略进一步从候选数据中去除了噪声标记样本。我们在四个流行的数据集上进行了实验,以充分验证所提出方法的通用性。实验结果表明,所提出的方法提高了所有比较基线工作的性能。