Suppr超能文献

用于少样本学习的解耦训练的转导关系传播

Transductive Relation-Propagation With Decoupling Training for Few-Shot Learning.

作者信息

Ma Yuqing, Bai Shihao, Liu Wei, Wang Shuo, Yu Yue, Bai Xiao, Liu Xianglong, Wang Meng

出版信息

IEEE Trans Neural Netw Learn Syst. 2022 Nov;33(11):6652-6664. doi: 10.1109/TNNLS.2021.3082928. Epub 2022 Oct 27.

Abstract

Few-shot learning, aiming to learn novel concepts from one or a few labeled examples, is an interesting and very challenging problem with many practical advantages. Existing few-shot methods usually utilize data of the same classes to train the feature embedding module and in a row, which is unable to learn adapting to new tasks. Besides, traditional few-shot models fail to take advantage of the valuable relations of the support-query pairs, leading to performance degradation. In this article, we propose a transductive relation-propagation graph neural network (GNN) with a decoupling training strategy (TRPN-D) to explicitly model and propagate such relations across support-query pairs, and empower the few-shot module the ability of transferring past knowledge to new tasks via the decoupling training. Our few-shot module, namely TRPN, treats the relation of each support-query pair as a graph node, named relational node, and resorts to the known relations between support samples, including both intraclass commonality and interclass uniqueness. Through relation propagation, the model could generate the discriminative relation embeddings for support-query pairs. To the best of our knowledge, this is the first work that decouples the training of the embedding network and the few-shot graph module with different tasks, which might offer a new way to solve the few-shot learning problem. Extensive experiments conducted on several benchmark datasets demonstrate that our method can significantly outperform a variety of state-of-the-art few-shot learning methods.

摘要

少样本学习旨在从一个或几个有标签的示例中学习新的概念,是一个有趣且极具挑战性的问题,具有诸多实际优势。现有的少样本方法通常连续利用同一类别的数据来训练特征嵌入模块,这使得模型无法学习适应新任务。此外,传统的少样本模型未能利用支持集 - 查询集对的宝贵关系,导致性能下降。在本文中,我们提出了一种具有解耦训练策略的转导关系传播图神经网络(GNN)(TRPN - D),以明确地对这种关系进行建模,并在支持集 - 查询集对之间传播这种关系,通过解耦训练赋予少样本模块将过去的知识转移到新任务的能力。我们的少样本模块,即TRPN,将每个支持集 - 查询集对的关系视为一个图节点,称为关系节点,并借助支持样本之间的已知关系,包括类内共性和类间独特性。通过关系传播,模型可以为支持集 - 查询集对生成有区分力的关系嵌入。据我们所知,这是第一项将嵌入网络和具有不同任务的少样本图模块的训练解耦的工作,这可能为解决少样本学习问题提供一种新方法。在几个基准数据集上进行的大量实验表明,我们的方法能够显著优于各种当前最先进的少样本学习方法。

相似文献

1
Transductive Relation-Propagation With Decoupling Training for Few-Shot Learning.
IEEE Trans Neural Netw Learn Syst. 2022 Nov;33(11):6652-6664. doi: 10.1109/TNNLS.2021.3082928. Epub 2022 Oct 27.
2
Ensemble Transductive Propagation Network for Semi-Supervised Few-Shot Learning.
Entropy (Basel). 2024 Jan 31;26(2):135. doi: 10.3390/e26020135.
3
Graph Few-Shot Learning via Restructuring Task Graph.
IEEE Trans Neural Netw Learn Syst. 2022 Jun 8;PP. doi: 10.1109/TNNLS.2022.3178849.
4
Hierarchical Knowledge Propagation and Distillation for Few-Shot Learning.
Neural Netw. 2023 Oct;167:615-625. doi: 10.1016/j.neunet.2023.08.040. Epub 2023 Sep 9.
5
A Multitask Latent Feature Augmentation Method for Few-Shot Learning.
IEEE Trans Neural Netw Learn Syst. 2024 May;35(5):6976-6990. doi: 10.1109/TNNLS.2022.3213576. Epub 2024 May 2.
7
Property-Aware Relation Networks for Few-Shot Molecular Property Prediction.
IEEE Trans Pattern Anal Mach Intell. 2024 Aug;46(8):5413-5429. doi: 10.1109/TPAMI.2024.3368090. Epub 2024 Jul 2.
8
LGLNN: Label Guided Graph Learning-Neural Network for few-shot learning.
Neural Netw. 2022 Nov;155:50-57. doi: 10.1016/j.neunet.2022.08.003. Epub 2022 Aug 6.
9
Word Embedding Distribution Propagation Graph Network for Few-Shot Learning.
Sensors (Basel). 2022 Mar 30;22(7):2648. doi: 10.3390/s22072648.
10
Capsule neural tensor networks with multi-aspect information for Few-shot Knowledge Graph Completion.
Neural Netw. 2023 Jul;164:323-334. doi: 10.1016/j.neunet.2023.04.041. Epub 2023 May 4.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验