Wang Zi, Yang Yang, Yuan Liyin, Li Chunlai, Wang Jianyu
Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China.
University of Chinese Academy of Sciences, Beijing 100049, China.
Sensors (Basel). 2024 Nov 29;24(23):7658. doi: 10.3390/s24237658.
Long-wave infrared (LWIR) spectral imaging plays a critical role in various applications such as gas monitoring, mineral exploration, and fire detection. Recent advancements in computational spectral imaging, powered by advanced algorithms, have enabled the acquisition of high-quality spectral images in real time, such as with the Uncooled Snapshot Infrared Spectrometer (USIRS). However, the USIRS system faces challenges, particularly a low spectral resolution and large amount of data noise, which can degrade the image quality. Deep learning has emerged as a promising solution to these challenges, as it is particularly effective at handling noisy data and has demonstrated significant success in hyperspectral imaging tasks. Nevertheless, the application of deep learning in LWIR imaging is hindered by the severe scarcity of long-wave hyperspectral image data, which limits the training of robust models. Moreover, existing networks that rely on convolutional layers or attention mechanisms struggle to effectively capture both local and global spectral correlations. To address these limitations, we propose the pixel-based Hierarchical Spectral Transformer (HST), a novel deep learning architecture that learns from publicly available single-pixel long-wave infrared spectral databases. The HST is designed to achieve a high spectral resolution for LWIR spectral image reconstruction, enhancing both the local and global contextual understanding of the spectral data. We evaluated the performance of the proposed method on both simulated and real-world LWIR data, demonstrating the robustness and effectiveness of the HST in improving the spectral resolution and mitigating noise, even with limited data.
长波红外(LWIR)光谱成像在气体监测、矿物勘探和火灾探测等各种应用中发挥着关键作用。由先进算法驱动的计算光谱成像的最新进展,使得能够实时获取高质量的光谱图像,例如非制冷快照红外光谱仪(USIRS)。然而,USIRS系统面临挑战,特别是光谱分辨率低和数据噪声量大,这会降低图像质量。深度学习已成为应对这些挑战的一种有前途的解决方案,因为它在处理噪声数据方面特别有效,并且在高光谱成像任务中已取得显著成功。尽管如此,深度学习在LWIR成像中的应用受到长波高光谱图像数据严重稀缺的阻碍,这限制了强大模型的训练。此外,现有的依赖卷积层或注意力机制的网络难以有效捕捉局部和全局光谱相关性。为了解决这些限制,我们提出了基于像素的分层光谱变换器(HST),这是一种新颖的深度学习架构,它从公开可用的单像素长波红外光谱数据库中学习。HST旨在为LWIR光谱图像重建实现高光谱分辨率,增强对光谱数据的局部和全局上下文理解。我们在模拟和真实的LWIR数据上评估了所提出方法的性能,证明了HST在提高光谱分辨率和减轻噪声方面的稳健性和有效性,即使在数据有限的情况下也是如此。