Ma Yuqing, Bai Shihao, Liu Wei, Wang Shuo, Yu Yue, Bai Xiao, Liu Xianglong, Wang Meng
IEEE Trans Neural Netw Learn Syst. 2022 Nov;33(11):6652-6664. doi: 10.1109/TNNLS.2021.3082928. Epub 2022 Oct 27.
Few-shot learning, aiming to learn novel concepts from one or a few labeled examples, is an interesting and very challenging problem with many practical advantages. Existing few-shot methods usually utilize data of the same classes to train the feature embedding module and in a row, which is unable to learn adapting to new tasks. Besides, traditional few-shot models fail to take advantage of the valuable relations of the support-query pairs, leading to performance degradation. In this article, we propose a transductive relation-propagation graph neural network (GNN) with a decoupling training strategy (TRPN-D) to explicitly model and propagate such relations across support-query pairs, and empower the few-shot module the ability of transferring past knowledge to new tasks via the decoupling training. Our few-shot module, namely TRPN, treats the relation of each support-query pair as a graph node, named relational node, and resorts to the known relations between support samples, including both intraclass commonality and interclass uniqueness. Through relation propagation, the model could generate the discriminative relation embeddings for support-query pairs. To the best of our knowledge, this is the first work that decouples the training of the embedding network and the few-shot graph module with different tasks, which might offer a new way to solve the few-shot learning problem. Extensive experiments conducted on several benchmark datasets demonstrate that our method can significantly outperform a variety of state-of-the-art few-shot learning methods.
少样本学习旨在从一个或几个有标签的示例中学习新的概念,是一个有趣且极具挑战性的问题,具有诸多实际优势。现有的少样本方法通常连续利用同一类别的数据来训练特征嵌入模块,这使得模型无法学习适应新任务。此外,传统的少样本模型未能利用支持集 - 查询集对的宝贵关系,导致性能下降。在本文中,我们提出了一种具有解耦训练策略的转导关系传播图神经网络(GNN)(TRPN - D),以明确地对这种关系进行建模,并在支持集 - 查询集对之间传播这种关系,通过解耦训练赋予少样本模块将过去的知识转移到新任务的能力。我们的少样本模块,即TRPN,将每个支持集 - 查询集对的关系视为一个图节点,称为关系节点,并借助支持样本之间的已知关系,包括类内共性和类间独特性。通过关系传播,模型可以为支持集 - 查询集对生成有区分力的关系嵌入。据我们所知,这是第一项将嵌入网络和具有不同任务的少样本图模块的训练解耦的工作,这可能为解决少样本学习问题提供一种新方法。在几个基准数据集上进行的大量实验表明,我们的方法能够显著优于各种当前最先进的少样本学习方法。