Zhu Qiqi, Deng Weihuan, Zheng Zhuo, Zhong Yanfei, Guan Qingfeng, Lin Weihua, Zhang Liangpei, Li Deren
IEEE Trans Cybern. 2022 Nov;52(11):11709-11723. doi: 10.1109/TCYB.2021.3070577. Epub 2022 Oct 17.
Deep learning techniques have been widely applied to hyperspectral image (HSI) classification and have achieved great success. However, the deep neural network model has a large parameter space and requires a large number of labeled data. Deep learning methods for HSI classification usually follow a patchwise learning framework. Recently, a fast patch-free global learning (FPGA) architecture was proposed for HSI classification according to global spatial context information. However, FPGA has difficulty in extracting the most discriminative features when the sample data are imbalanced. In this article, a spectral-spatial-dependent global learning (SSDGL) framework based on the global convolutional long short-term memory (GCL) and global joint attention mechanism (GJAM) is proposed for insufficient and imbalanced HSI classification. In SSDGL, the hierarchically balanced (H-B) sampling strategy and the weighted softmax loss are proposed to address the imbalanced sample problem. To effectively distinguish similar spectral characteristics of land cover types, the GCL module is introduced to extract the long short-term dependency of spectral features. To learn the most discriminative feature representations, the GJAM module is proposed to extract attention areas. The experimental results obtained with three public HSI datasets show that the SSDGL has powerful performance in insufficient and imbalanced sample problems and is superior to other state-of-the-art methods.
深度学习技术已被广泛应用于高光谱图像(HSI)分类,并取得了巨大成功。然而,深度神经网络模型具有较大的参数空间,需要大量的标注数据。用于HSI分类的深度学习方法通常遵循逐块学习框架。最近,根据全局空间上下文信息,提出了一种用于HSI分类的快速无块全局学习(FPGA)架构。然而,当样本数据不均衡时,FPGA在提取最具判别力的特征方面存在困难。在本文中,针对不足和不均衡的HSI分类问题,提出了一种基于全局卷积长短期记忆(GCL)和全局联合注意力机制(GJAM)的光谱-空间依赖全局学习(SSDGL)框架。在SSDGL中,提出了分层平衡(H-B)采样策略和加权softmax损失来解决样本不均衡问题。为了有效区分土地覆盖类型的相似光谱特征,引入GCL模块来提取光谱特征的长短期依赖性。为了学习最具判别力的特征表示,提出了GJAM模块来提取注意力区域。使用三个公共HSI数据集获得的实验结果表明,SSDGL在不足和不均衡样本问题上具有强大的性能,优于其他现有最先进方法。