Gao Kuiliang, Liu Bing, Yu Xuchu, Yu Anzhu
IEEE Trans Image Process. 2022;31:3449-3462. doi: 10.1109/TIP.2022.3169689. Epub 2022 May 11.
The difficulties of obtaining sufficient labeled samples have always been one of the factors hindering deep learning models from obtaining high accuracy in hyperspectral image (HSI) classification. To reduce the dependence of deep learning models on training samples, meta learning methods have been introduced, effectively improving the classification accuracy in small sample set scenarios. However, the existing methods based on meta learning still need to construct a labeled source data set with several pre-collected HSIs, and must utilize a large number of labeled samples for meta-training, which is actually time-consuming and labor-intensive. To solve this problem, this paper proposes a novel unsupervised meta learning method with multiview constraints for HSI small sample set classification. Specifically, the proposed method first builds an unlabeled source data set using unlabeled HSIs. Then, multiple spatial-spectral multiview features of each unlabeled sample are generated to construct tasks for unsupervised meta learning. Finally, the designed residual relation network is used for meta-training and small sample set classification based on the voting strategy. Compared with existing supervised meta learning methods for HSI classification, our method can only utilize HSIs without any label for unsupervised meta learning, which significantly reduces the number of requisite labeled samples in the whole classification process. To verify the effectiveness of the proposed method, extensive experiments are carried out on 8 public HSIs in the cross-domain and in-domain classification scenarios. The statistical results demonstrate that, compared with existing supervised meta learning methods and other advanced classification models, the proposed method can achieve competitive or better classification performance in small sample set scenarios.
获取足够的标注样本困难一直是阻碍深度学习模型在高光谱图像(HSI)分类中获得高精度的因素之一。为了减少深度学习模型对训练样本的依赖,引入了元学习方法,有效提高了小样本集场景下的分类精度。然而,现有的基于元学习的方法仍然需要用几个预先收集的高光谱图像构建一个标注源数据集,并且必须利用大量标注样本进行元训练,这实际上既耗时又费力。为了解决这个问题,本文提出了一种用于HSI小样本集分类的具有多视图约束的新型无监督元学习方法。具体来说,该方法首先使用未标注的高光谱图像构建一个未标注源数据集。然后,生成每个未标注样本的多个空间 - 光谱多视图特征,以构建无监督元学习的任务。最后,基于投票策略,使用设计的残差关系网络进行元训练和小样本集分类。与现有的用于HSI分类的有监督元学习方法相比,我们的方法在无监督元学习中仅利用没有任何标签的高光谱图像,这在整个分类过程中显著减少了所需标注样本的数量。为了验证所提方法的有效性,在跨域和域内分类场景下对8个公共高光谱图像进行了广泛实验。统计结果表明,与现有的有监督元学习方法和其他先进分类模型相比,所提方法在小样本集场景下能够实现具有竞争力或更好的分类性能。