• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

自适应分类器-预测器的元学习以实现小样本学习。

Learning to Learn Adaptive Classifier-Predictor for Few-Shot Learning.

出版信息

IEEE Trans Neural Netw Learn Syst. 2021 Aug;32(8):3458-3470. doi: 10.1109/TNNLS.2020.3011526. Epub 2021 Aug 3.

DOI:10.1109/TNNLS.2020.3011526
PMID:32755872
Abstract

Few-shot learning aims to learn a well-performing model from a few labeled examples. Recently, quite a few works propose to learn a predictor to directly generate model parameter weights with episodic training strategy of meta-learning and achieve fairly promising performance. However, the predictor in these works is task-agnostic, which means that the predictor cannot adjust to novel tasks in the testing phase. In this article, we propose a novel meta-learning method to learn how to learn task-adaptive classifier-predictor to generate classifier weights for few-shot classification. Specifically, a meta classifier-predictor module, (MPM) is introduced to learn how to adaptively update a task-agnostic classifier-predictor to a task-specialized one on a novel task with a newly proposed center-uniqueness loss function. Compared with previous works, our task-adaptive classifier-predictor can better capture characteristics of each category in a novel task and thus generate a more accurate and effective classifier. Our method is evaluated on two commonly used benchmarks for few-shot classification, i.e., miniImageNet and tieredImageNet. Ablation study verifies the necessity of learning task-adaptive classifier-predictor and the effectiveness of our newly proposed center-uniqueness loss. Moreover, our method achieves the state-of-the-art performance on both benchmarks, thus demonstrating its superiority.

摘要

少样本学习旨在从少数带标签的示例中学习表现良好的模型。最近,相当多的工作提出学习一个预测器,通过元学习的阶段性训练策略直接生成模型参数权重,从而取得相当有前景的性能。然而,这些工作中的预测器是任务不可知的,这意味着预测器不能在测试阶段适应新任务。在本文中,我们提出了一种新的元学习方法,学习如何学习任务自适应分类器-预测器,以生成用于少样本分类的分类器权重。具体来说,引入了一个元分类器-预测器模块(MPM),以学习如何自适应地将任务不可知的分类器-预测器更新为新任务上的任务专门化的分类器-预测器,使用新提出的中心唯一性损失函数。与以前的工作相比,我们的任务自适应分类器-预测器可以更好地捕捉新任务中每个类别的特征,从而生成更准确和有效的分类器。我们的方法在两个常用的少样本分类基准上进行了评估,即 miniImageNet 和 tieredImageNet。消融研究验证了学习任务自适应分类器-预测器的必要性和我们新提出的中心唯一性损失的有效性。此外,我们的方法在两个基准上都取得了最先进的性能,从而证明了其优越性。

相似文献

1
Learning to Learn Adaptive Classifier-Predictor for Few-Shot Learning.自适应分类器-预测器的元学习以实现小样本学习。
IEEE Trans Neural Netw Learn Syst. 2021 Aug;32(8):3458-3470. doi: 10.1109/TNNLS.2020.3011526. Epub 2021 Aug 3.
2
Few-Shot Learning With a Strong Teacher.借助强大教师的少样本学习。
IEEE Trans Pattern Anal Mach Intell. 2024 Mar;46(3):1425-1440. doi: 10.1109/TPAMI.2022.3160362. Epub 2024 Feb 6.
3
Meta-Transfer Learning Through Hard Tasks.元迁移学习通过硬任务。
IEEE Trans Pattern Anal Mach Intell. 2022 Mar;44(3):1443-1456. doi: 10.1109/TPAMI.2020.3018506. Epub 2022 Feb 3.
4
Learning to Learn Task-Adaptive Hyperparameters for Few-Shot Learning.为少样本学习学习任务自适应超参数
IEEE Trans Pattern Anal Mach Intell. 2024 Mar;46(3):1441-1454. doi: 10.1109/TPAMI.2023.3261387. Epub 2024 Feb 6.
5
Meta-Prototypical Learning for Domain-Agnostic Few-Shot Recognition.用于领域无关少样本识别的元原型学习
IEEE Trans Neural Netw Learn Syst. 2022 Nov;33(11):6990-6996. doi: 10.1109/TNNLS.2021.3083650. Epub 2022 Oct 27.
6
A novel meta-learning framework: Multi-features adaptive aggregation method with information enhancer.一种新的元学习框架:带有信息增强器的多特征自适应聚合方法。
Neural Netw. 2021 Dec;144:755-765. doi: 10.1016/j.neunet.2021.09.029. Epub 2021 Oct 7.
7
Piecewise Classifier Mappings: Learning Fine-Grained Learners for Novel Categories With Few Examples.分段分类器映射:利用少量示例学习新颖类别中的细粒度学习者。
IEEE Trans Image Process. 2019 Dec;28(12):6116-6125. doi: 10.1109/TIP.2019.2924811. Epub 2019 Jul 1.
8
Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks.通过少样本任务的特征重新审视无监督元学习
IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):3721-3737. doi: 10.1109/TPAMI.2022.3179368. Epub 2023 Feb 3.
9
Bridging the Gap Between Few-Shot and Many-Shot Learning via Distribution Calibration.通过分布校准弥合少样本学习与多样本学习之间的差距
IEEE Trans Pattern Anal Mach Intell. 2022 Dec;44(12):9830-9843. doi: 10.1109/TPAMI.2021.3132021. Epub 2022 Nov 7.
10
Expandable-RCNN: toward high-efficiency incremental few-shot object detection.可扩展区域卷积神经网络:迈向高效增量少样本目标检测
Front Artif Intell. 2024 Apr 23;7:1377337. doi: 10.3389/frai.2024.1377337. eCollection 2024.

引用本文的文献

1
Semantic Interaction Meta-Learning Based on Patch Matching Metric.基于补丁匹配度量的语义交互元学习
Sensors (Basel). 2024 Aug 30;24(17):5620. doi: 10.3390/s24175620.
2
Meta learning based residual network for industrial production quality prediction with limited data.基于元学习的残差网络用于有限数据下的工业生产质量预测
Sci Rep. 2024 May 25;14(1):11963. doi: 10.1038/s41598-024-62174-0.
3
A pairwise functional connectivity similarity measure method based on few-shot learning for early MCI detection.一种基于少样本学习的成对功能连接相似性度量方法用于早期轻度认知障碍检测。
Front Neurosci. 2022 Dec 19;16:1081788. doi: 10.3389/fnins.2022.1081788. eCollection 2022.
4
Hybrid Fine-Tuning Strategy for Few-Shot Classification.基于混合微调策略的小样本分类方法。
Comput Intell Neurosci. 2022 Oct 8;2022:9620755. doi: 10.1155/2022/9620755. eCollection 2022.
5
A Few-Shot Learning Approach Assists in the Prognosis Prediction of Magnetic Resonance-Guided Focused Ultrasound for the Local Control of Bone Metastatic Lesions.少样本学习方法助力磁共振引导聚焦超声对骨转移瘤局部控制的预后预测
Cancers (Basel). 2022 Jan 17;14(2):445. doi: 10.3390/cancers14020445.
6
Application of Machine Learning for the Prediction of Etiological Types of Classic Fever of Unknown Origin.机器学习在不明原因经典热病因预测中的应用。
Front Public Health. 2021 Dec 24;9:800549. doi: 10.3389/fpubh.2021.800549. eCollection 2021.
7
Editorial: Cross-Domain Analysis for "All of Us" Precision Medicine.社论:“我们所有人”精准医学的跨领域分析
Front Genet. 2021 Jul 1;12:713771. doi: 10.3389/fgene.2021.713771. eCollection 2021.