Dian Renwei, Li Shutao, Fang Leyuan
IEEE Trans Neural Netw Learn Syst. 2019 Sep;30(9):2672-2683. doi: 10.1109/TNNLS.2018.2885616. Epub 2019 Jan 7.
Hyperspectral images (HSIs) with high spectral resolution only have the low spatial resolution. On the contrary, multispectral images (MSIs) with much lower spectral resolution can be obtained with higher spatial resolution. Therefore, fusing the high-spatial-resolution MSI (HR-MSI) with low-spatial-resolution HSI of the same scene has become the very popular HSI super-resolution scheme. In this paper, a novel low tensor-train (TT) rank (LTTR)-based HSI super-resolution method is proposed, where an LTTR prior is designed to learn the correlations among the spatial, spectral, and nonlocal modes of the nonlocal similar high-spatial-resolution HSI (HR-HSI) cubes. First, we cluster the HR-MSI cubes as many groups based on their similarities, and the HR-HSI cubes are also clustered according to the learned cluster structure in the HR-MSI cubes. The HR-HSI cubes in each group are much similar to each other and can constitute a 4-D tensor, whose four modes are highly correlated. Therefore, we impose the LTTR constraint on these 4-D tensors, which can effectively learn the correlations among the spatial, spectral, and nonlocal modes because of the well-balanced matricization scheme of TT rank. We formulate the super-resolution problem as TT rank regularized optimization problem, which is solved via the scheme of alternating direction method of multipliers. Experiments on HSI data sets indicate the effectiveness of the LTTR-based method.
具有高光谱分辨率的高光谱图像(HSIs)仅具有低空间分辨率。相反,光谱分辨率低得多的多光谱图像(MSIs)可以以更高的空间分辨率获得。因此,将同一场景的高空间分辨率多光谱图像(HR-MSI)与低空间分辨率高光谱图像(HSI)进行融合已成为非常流行的高光谱图像超分辨率方案。本文提出了一种基于低张量列车(TT)秩(LTTR)的新型高光谱图像超分辨率方法,其中设计了一个LTTR先验来学习非局部相似高空间分辨率高光谱图像(HR-HSI)立方体的空间、光谱和非局部模式之间的相关性。首先,我们根据HR-MSI立方体的相似性将其聚类为多个组,并且HR-HSI立方体也根据在HR-MSI立方体中学习到的聚类结构进行聚类。每个组中的HR-HSI立方体彼此非常相似,并且可以构成一个4维张量,其四个模式高度相关。因此,我们对这些4维张量施加LTTR约束,由于TT秩的平衡矩阵化方案,该约束可以有效地学习空间、光谱和非局部模式之间的相关性。我们将超分辨率问题表述为TT秩正则化优化问题,并通过乘子交替方向法进行求解。在高光谱图像数据集上的实验表明了基于LTTR方法的有效性。