School of Future Technology, University of Chinese Academy of Sciences, Beijing, 100039, China.
School of Computer Science and Technology, Xidian University, Xi'an, 710071, China.
Sci Rep. 2022 Jul 13;12(1):11905. doi: 10.1038/s41598-022-16223-1.
Hyperspectral imaging enables many versatile applications for its competence in capturing abundant spatial and spectral information, which is crucial for identifying substances. However, the devices for acquiring hyperspectral images are typically expensive and very complicated, hindering the promotion of their application in consumer electronics, such as daily food inspection and point-of-care medical screening, etc. Recently, many computational spectral imaging methods have been proposed by directly reconstructing the hyperspectral information from widely available RGB images. These reconstruction methods can exclude the usage of burdensome spectral camera hardware while keeping a high spectral resolution and imaging performance. We present a thorough investigation of more than 25 state-of-the-art spectral reconstruction methods which are categorized as prior-based and data-driven methods. Simulations on open-source datasets show that prior-based methods are more suitable for rare data situations, while data-driven methods can unleash the full potential of deep learning in big data cases. We have identified current challenges faced by those methods (e.g., loss function, spectral accuracy, data generalization) and summarized a few trends for future work. With the rapid expansion in datasets and the advent of more advanced neural networks, learnable methods with fine feature representation abilities are very promising. This comprehensive review can serve as a fruitful reference source for peer researchers, thus paving the way for the development of computational hyperspectral imaging.
高光谱成像是一种多功能应用技术,它能够捕获丰富的空间和光谱信息,这对于识别物质至关重要。然而,获取高光谱图像的设备通常价格昂贵且非常复杂,这阻碍了它们在消费电子产品中的应用,如日常食品检查和即时医疗筛查等。最近,许多计算光谱成像方法已经被提出,这些方法通过直接从广泛可用的 RGB 图像重建高光谱信息。这些重建方法可以避免使用繁琐的光谱相机硬件,同时保持高光谱分辨率和成像性能。我们对 25 种以上的最新光谱重建方法进行了全面的调查,这些方法分为基于先验和数据驱动的方法。在开源数据集上的模拟表明,基于先验的方法更适合于稀有数据情况,而数据驱动的方法可以在大数据情况下充分发挥深度学习的潜力。我们已经确定了这些方法所面临的当前挑战(例如,损失函数、光谱精度、数据泛化),并总结了未来工作的几个趋势。随着数据集的快速扩展和更先进的神经网络的出现,具有精细特征表示能力的可学习方法非常有前途。本综述可以为同行研究人员提供一个有益的参考来源,从而为计算高光谱成像的发展铺平道路。