Xiong Fengchao, Zhou Jun, Tao Shuyin, Lu Jianfeng, Zhou Jiantao, Qian Yuntao
IEEE Trans Image Process. 2022;31:5469-5483. doi: 10.1109/TIP.2022.3196826. Epub 2022 Aug 17.
Deep learning (DL) based hyperspectral images (HSIs) denoising approaches directly learn the nonlinear mapping between noisy and clean HSI pairs. They usually do not consider the physical characteristics of HSIs. This drawback makes the models lack interpretability that is key to understanding their denoising mechanism and limits their denoising ability. In this paper, we introduce a novel model-guided interpretable network for HSI denoising to tackle this problem. Fully considering the spatial redundancy, spectral low-rankness, and spectral-spatial correlations of HSIs, we first establish a subspace-based multidimensional sparse (SMDS) model under the umbrella of tensor notation. After that, the model is unfolded into an end-to-end network named SMDS-Net, whose fundamental modules are seamlessly connected with the denoising procedure and optimization of the SMDS model. This makes SMDS-Net convey clear physical meanings, i.e., learning the low-rankness and sparsity of HSIs. Finally, all key variables are obtained by discriminative training. Extensive experiments and comprehensive analysis on synthetic and real-world HSIs confirm the strong denoising ability, strong learning capability, promising generalization ability, and high interpretability of SMDS-Net against the state-of-the-art HSI denoising methods. The source code and data of this article will be made publicly available at https://github.com/bearshng/smds-net for reproducible research.
基于深度学习(DL)的高光谱图像(HSIs)去噪方法直接学习噪声HSI对与干净HSI对之间的非线性映射。它们通常不考虑HSIs的物理特性。这一缺点使得模型缺乏可解释性,而可解释性是理解其去噪机制的关键,并且限制了它们的去噪能力。在本文中,我们引入了一种用于HSI去噪的新型模型引导可解释网络来解决这个问题。充分考虑HSIs的空间冗余性、光谱低秩性和光谱-空间相关性,我们首先在张量表示法的框架下建立了一个基于子空间的多维稀疏(SMDS)模型。之后,该模型被展开为一个名为SMDS-Net的端到端网络,其基本模块与SMDS模型的去噪过程和优化无缝连接。这使得SMDS-Net具有清晰的物理意义,即学习HSIs的低秩性和稀疏性。最后,通过判别训练获得所有关键变量。对合成和真实世界HSIs进行的大量实验和综合分析证实,与最先进的HSI去噪方法相比,SMDS-Net具有强大的去噪能力、强大的学习能力、良好的泛化能力和高可解释性。本文的源代码和数据将在https://github.com/bearshng/smds-net上公开提供,以进行可重复研究。