Sun Le, He Chengxun, Zheng Yuhui, Wu Zebin, Jeon Byeungwoo
IEEE Trans Image Process. 2023;32:100-115. doi: 10.1109/TIP.2022.3226406. Epub 2022 Dec 19.
Low-rank tensor representation philosophy has enjoyed a reputation in many hyperspectral image (HSI) low-level vision applications, but previous studies often failed to comprehensively exploit the low-rank nature of HSI along different modes in low-dimensional subspace, and unsurprisingly handled only one specific task. To address these challenges, in this paper, we figured out that in addition to the spatial correlation, the spectral dependency of HSI also implicitly exists in the coefficient tensor of its subspace, this crucial dependency that was not fully utilized by previous studies yet can be effectively exploited in a cascaded manner. This led us to propose a unified subspace low-rank learning regime with a new tensor cascaded rank minimization, named STCR, to fully couple the low-rankness of HSI in different domains for various low-level vision tasks. Technically, the high-dimensional HSI was first projected into a low-dimensional tensor subspace, then a novel tensor low-cascaded-rank decomposition was designed to collapse the constructed tensor into three core tensors in succession to more thoroughly exploit the correlations in spatial, nonlocal, and spectral modes of the coefficient tensor. Next, difference continuity-regularization was introduced to learn a basis that more closely approximates the HSI's endmembers. The proposed regime realizes a comprehensive delineation of the self-portrait of HSI tensor. Extensive evaluations conducted with dozens of state-of-the-art (SOTA) baselines on eight datasets verified that the proposed regime is highly effective and robust to typical HSI low-level vision tasks, including denoising, compressive sensing reconstruction, inpainting, and destriping. The source code of our method is released at https://github.com/CX-He/STCR.git.
低秩张量表示理念在许多高光谱图像(HSI)低级视觉应用中享有盛誉,但以往的研究往往未能在低维子空间中沿不同模式全面利用HSI的低秩特性,并且不出所料地只处理了一个特定任务。为应对这些挑战,在本文中,我们发现除了空间相关性外,HSI的光谱依赖性也隐含在其子空间的系数张量中,这种关键的依赖性此前尚未被充分利用,但可以通过级联方式有效利用。这促使我们提出一种统一的子空间低秩学习机制,采用一种新的张量级联秩最小化方法,称为STCR,以在不同域中充分耦合HSI的低秩性,用于各种低级视觉任务。从技术上讲,首先将高维HSI投影到低维张量子空间中,然后设计一种新颖的张量低阶级联秩分解,将构造的张量依次分解为三个核心张量,以更全面地利用系数张量在空间、非局部和光谱模式中的相关性。接下来,引入差异连续性正则化来学习一个更接近HSI端元的基。所提出的机制实现了对HSI张量自画像的全面描绘。在八个数据集上使用数十个最新(SOTA)基线进行的广泛评估验证了所提出的机制对于典型的HSI低级视觉任务(包括去噪、压缩感知重建、修复和去条带)非常有效且稳健。我们方法的源代码可在https://github.com/CX-He/STCR.git上获取。