IEEE Trans Pattern Anal Mach Intell. 2023 Aug;45(8):9757-9773. doi: 10.1109/TPAMI.2023.3244023. Epub 2023 Jun 30.
Robust few-shot learning (RFSL), which aims to address noisy labels in few-shot learning, has recently gained considerable attention. Existing RFSL methods are based on the assumption that the noise comes from known classes (in-domain), which is inconsistent with many real-world scenarios where the noise does not belong to any known classes (out-of-domain). We refer to this more complex scenario as open-world few-shot learning (OFSL), where in-domain and out-of-domain noise simultaneously exists in few-shot datasets. To address the challenging problem, we propose a unified framework to implement comprehensive calibration from instance to metric. Specifically, we design a dual-networks structure composed of a contrastive network and a meta network to respectively extract feature-related intra-class information and enlarged inter-class variations. For instance-wise calibration, we present a novel prototype modification strategy to aggregate prototypes with intra-class and inter-class instance reweighting. For metric-wise calibration, we present a novel metric to implicitly scale the per-class prediction by fusing two spatial metrics respectively constructed by the two networks. In this way, the impact of noise in OFSL can be effectively mitigated from both feature space and label space. Extensive experiments on various OFSL settings demonstrate the robustness and superiority of our method. Our source codes is available at https://github.com/anyuexuan/IDEAL.
鲁棒少样本学习 (RFSL) 旨在解决少样本学习中的噪声标签问题,最近受到了广泛关注。现有的 RFSL 方法基于噪声来自已知类别的假设(域内),但这与许多实际情况不一致,在这些情况下,噪声不属于任何已知类别(域外)。我们将这种更复杂的情况称为开放世界少样本学习 (OFSL),其中域内和域外噪声同时存在于少样本数据集中。为了解决这个具有挑战性的问题,我们提出了一个统一的框架,从实例到度量实现全面校准。具体来说,我们设计了一个由对比网络和元网络组成的双网络结构,分别提取特征相关的类内信息和扩大的类间变化。对于实例级校准,我们提出了一种新颖的原型修改策略,通过类内和类间实例重新加权来聚合原型。对于度量级校准,我们提出了一种新的度量标准,通过融合由两个网络分别构建的两个空间度量标准,隐式地对每个类别的预测进行缩放。通过这种方式,可以从特征空间和标签空间有效减轻 OFSL 中的噪声影响。在各种 OFSL 设置上的广泛实验证明了我们方法的稳健性和优越性。我们的源代码可在 https://github.com/anyuexuan/IDEAL 上获得。