He Wei, Yokoya Naoto, Yuan Xin
IEEE Trans Image Process. 2021;30:7170-7183. doi: 10.1109/TIP.2021.3101916. Epub 2021 Aug 12.
Coded aperture snapshot spectral imaging (CASSI) is a promising technique for capturing three-dimensional hyperspectral images (HSIs), in which algorithms are used to perform the inverse problem of HSI reconstruction from a single coded two-dimensional (2D) measurement. Due to the ill-posed nature of this problem, various regularizers have been exploited to reconstruct 3D data from 2D measurements. Unfortunately, the accuracy and computational complexity are unsatisfactory. One feasible solution is to utilize additional information such as the RGB measurement in CASSI. Considering the combined CASSI and RGB measurements, in this paper, we propose a fusion model for HSI reconstruction. Specifically, we investigate the low-dimensional spectral subspace property of HSIs composed of a spectral basis and spatial coefficients. In particular, the RGB measurement is utilized to estimate the coefficients, while the CASSI measurement is adopted to provide the spectral basis. We further propose a patch processing strategy to enhance the spectral low-rank property of HSIs. The optimization of the proposed model requires neither iteration nor the spectral sensing matrix of the RGB detector. Extensive experiments on both simulated and real HSI datasets demonstrate that our proposed method not only outperforms previous state-of-the-art (iterative algorithms) methods in quality but also speeds up the reconstruction by more than 5000 times.
编码孔径快照光谱成像(CASSI)是一种用于获取三维高光谱图像(HSI)的有前景的技术,其中算法被用于从单个编码二维(2D)测量中执行HSI重建的逆问题。由于该问题的不适定性,已采用各种正则化方法从二维测量中重建三维数据。不幸的是,准确性和计算复杂度并不令人满意。一种可行的解决方案是利用诸如CASSI中的RGB测量等附加信息。考虑到CASSI和RGB测量的结合,在本文中,我们提出了一种用于HSI重建的融合模型。具体而言,我们研究了由光谱基和空间系数组成的HSI的低维光谱子空间特性。特别地,利用RGB测量来估计系数,同时采用CASSI测量来提供光谱基。我们进一步提出了一种补丁处理策略来增强HSI的光谱低秩特性。所提出模型的优化既不需要迭代也不需要RGB探测器的光谱传感矩阵。在模拟和真实HSI数据集上进行的大量实验表明,我们提出的方法不仅在质量上优于先前的最先进(迭代算法)方法,而且将重建速度提高了5000倍以上。