• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于原型网络的标签平滑和任务自适应损失函数的少样本学习。

Label smoothing and task-adaptive loss function based on prototype network for few-shot learning.

机构信息

School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China.

出版信息

Neural Netw. 2022 Dec;156:39-48. doi: 10.1016/j.neunet.2022.09.018. Epub 2022 Sep 23.

DOI:10.1016/j.neunet.2022.09.018
PMID:36228337
Abstract

Aiming at solving the problems of prototype network that the label information is not reliable enough and that the hyperparameters of the loss function cannot follow the changes of image feature information, we propose a method that combines label smoothing and hyperparameters. First, the label information of an image is processed by label smoothing regularization. Then, according to different classification tasks, the distance matrix and logarithmic operation of the image feature are used to fuse the distance matrix of the image with the hyperparameters of the loss function. Finally, the hyperparameters are associated with the smoothed label and the distance matrix for predictive classification. The method is validated on the miniImageNet, FC100 and tieredImageNet datasets. The results show that, compared with the unsmoothed label and fixed hyperparameters methods, the classification accuracy of the flexible hyperparameters in the loss function under the condition of few-shot learning is improved by 2%-3%. The result shows that the proposed method can suppress the interference of false labels, and the flexibility of hyperparameters can improve classification accuracy.

摘要

针对原型网络标签信息不可靠和损失函数超参数无法跟随图像特征信息变化的问题,提出一种结合标签平滑和超参数的方法。首先,对图像的标签信息进行标签平滑正则化处理。然后,根据不同分类任务,利用图像特征的距离矩阵和对数运算,融合图像的距离矩阵与损失函数的超参数。最后,将超参数与平滑后的标签和距离矩阵进行预测分类。在 miniImageNet、FC100 和 tieredImageNet 数据集上进行验证。结果表明,与未平滑标签和固定超参数方法相比,在少样本学习条件下,损失函数中灵活的超参数的分类准确率提高了 2%~3%。结果表明,所提出的方法可以抑制错误标签的干扰,超参数的灵活性可以提高分类准确率。

相似文献

1
Label smoothing and task-adaptive loss function based on prototype network for few-shot learning.基于原型网络的标签平滑和任务自适应损失函数的少样本学习。
Neural Netw. 2022 Dec;156:39-48. doi: 10.1016/j.neunet.2022.09.018. Epub 2022 Sep 23.
2
DeepEMD: Differentiable Earth Mover's Distance for Few-Shot Learning.DeepEMD:用于Few-Shot Learning 的可微分 Earth Mover's Distance。
IEEE Trans Pattern Anal Mach Intell. 2023 May;45(5):5632-5648. doi: 10.1109/TPAMI.2022.3217373. Epub 2023 Apr 3.
3
Learning to Learn Task-Adaptive Hyperparameters for Few-Shot Learning.为少样本学习学习任务自适应超参数
IEEE Trans Pattern Anal Mach Intell. 2024 Mar;46(3):1441-1454. doi: 10.1109/TPAMI.2023.3261387. Epub 2024 Feb 6.
4
Learning label smoothing for text classification.用于文本分类的学习标签平滑。
PeerJ Comput Sci. 2024 Apr 23;10:e2005. doi: 10.7717/peerj-cs.2005. eCollection 2024.
5
Learning to Learn Adaptive Classifier-Predictor for Few-Shot Learning.自适应分类器-预测器的元学习以实现小样本学习。
IEEE Trans Neural Netw Learn Syst. 2021 Aug;32(8):3458-3470. doi: 10.1109/TNNLS.2020.3011526. Epub 2021 Aug 3.
6
Meta-Transfer Learning Through Hard Tasks.元迁移学习通过硬任务。
IEEE Trans Pattern Anal Mach Intell. 2022 Mar;44(3):1443-1456. doi: 10.1109/TPAMI.2020.3018506. Epub 2022 Feb 3.
7
Adaptive Prototypical Networks With Label Words and Joint Representation Learning for Few-Shot Relation Classification.基于标签词和联合表示学习的自适应原型网络用于少样本关系分类
IEEE Trans Neural Netw Learn Syst. 2023 Mar;34(3):1406-1417. doi: 10.1109/TNNLS.2021.3105377. Epub 2023 Feb 28.
8
Improving Embedding Generalization in Few-Shot Learning With Instance Neighbor Constraints.通过实例邻居约束改进少样本学习中的嵌入泛化。
IEEE Trans Image Process. 2023;32:5197-5208. doi: 10.1109/TIP.2023.3310329. Epub 2023 Sep 15.
9
Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration.通过高效原型重放和校准实现少样本类别增量学习
Entropy (Basel). 2023 May 10;25(5):776. doi: 10.3390/e25050776.
10
A cross-modal deep metric learning model for disease diagnosis based on chest x-ray images.一种基于胸部X光图像的用于疾病诊断的跨模态深度度量学习模型。
Multimed Tools Appl. 2023 Mar 15:1-22. doi: 10.1007/s11042-023-14790-7.

引用本文的文献

1
Auxiliary meta-learning strategy for cancer recognition: leveraging external data and optimized feature mapping.用于癌症识别的辅助元学习策略:利用外部数据和优化特征映射
BMC Cancer. 2025 Feb 27;25(1):367. doi: 10.1186/s12885-025-13740-w.
2
Multi-dimensional perceptual recognition of tourist destination using deep learning model and geographic information system.基于深度学习模型和地理信息系统的旅游目的地多维感知识别
PLoS One. 2025 Feb 7;20(2):e0318846. doi: 10.1371/journal.pone.0318846. eCollection 2025.