• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于高光谱图像超分辨率的跨范围空间光谱信息聚合

Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution.

作者信息

Chen Shi, Zhang Lefei, Zhang Liangpei

出版信息

IEEE Trans Image Process. 2024;33:5878-5891. doi: 10.1109/TIP.2024.3468905. Epub 2024 Oct 18.

DOI:10.1109/TIP.2024.3468905
PMID:39405141
Abstract

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global spatial-spectral information. The prevailing transformer-based methods have not adequately captured the long-range dependencies in both spectral and spatial dimensions. To alleviate this issue, we propose a novel cross-scope spatial-spectral Transformer (CST) to efficiently investigate long-range spatial and spectral similarities for single hyperspectral image super-resolution. Specifically, we devise cross-attention mechanisms in spatial and spectral dimensions to comprehensively model the long-range spatial-spectral characteristics. By integrating global information into the rectangle-window self-attention, we first design a cross-scope spatial self-attention to facilitate long-range spatial interactions. Then, by leveraging appropriately characteristic spatial-spectral features, we construct a cross-scope spectral self-attention to effectively capture the intrinsic correlations among global spectral bands. Finally, we elaborate a concise feed-forward neural network to enhance the feature representation capacity in the Transformer structure. Extensive experiments over three hyperspectral datasets demonstrate that the proposed CST is superior to other state-of-the-art methods both quantitatively and visually. The code is available at https://github.com/Tomchenshi/CST.git.

摘要

高光谱图像超分辨率技术已在提升高光谱图像空间分辨率方面得到广泛关注。然而,基于卷积的方法在利用全局空间-光谱信息时面临挑战。主流的基于Transformer的方法未能充分捕捉光谱和空间维度上的长程依赖关系。为缓解这一问题,我们提出一种新颖的跨域空间-光谱Transformer(CST),以高效研究单幅高光谱图像超分辨率中的长程空间和光谱相似性。具体而言,我们在空间和光谱维度设计了交叉注意力机制,以全面建模长程空间-光谱特征。通过将全局信息整合到矩形窗口自注意力中,我们首先设计了一种跨域空间自注意力,以促进长程空间交互。然后,通过利用适当的特征空间-光谱特征,我们构建了一种跨域光谱自注意力,以有效捕捉全局光谱波段之间的内在相关性。最后,我们精心设计了一个简洁的前馈神经网络,以增强Transformer结构中的特征表示能力。在三个高光谱数据集上进行的大量实验表明,所提出的CST在定量和视觉上均优于其他现有先进方法。代码可在https://github.com/Tomchenshi/CST.git获取。

相似文献

1
Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution.用于高光谱图像超分辨率的跨范围空间光谱信息聚合
IEEE Trans Image Process. 2024;33:5878-5891. doi: 10.1109/TIP.2024.3468905. Epub 2024 Oct 18.
2
Exploring the Spectral Prior for Hyperspectral Image Super-Resolution.探索用于高光谱图像超分辨率的光谱先验
IEEE Trans Image Process. 2024;33:5260-5272. doi: 10.1109/TIP.2024.3460470. Epub 2024 Sep 27.
3
HMFT: Hyperspectral and Multispectral Image Fusion Super-Resolution Method Based on Efficient Transformer and Spatial-Spectral Attention Mechanism.基于高效Transformer 和空间-谱注意力机制的高光谱与多光谱图像融合超分辨率方法
Comput Intell Neurosci. 2023 Mar 1;2023:4725986. doi: 10.1155/2023/4725986. eCollection 2023.
4
Multistage Spatial-Spectral Fusion Network for Spectral Super-Resolution.用于光谱超分辨率的多阶段空间-光谱融合网络
IEEE Trans Neural Netw Learn Syst. 2024 Oct 10;PP. doi: 10.1109/TNNLS.2024.3460190.
5
Hider: A Hyperspectral Image Denoising Transformer With Spatial-Spectral Constraints for Hybrid Noise Removal.Hider:一种具有空间光谱约束的用于去除混合噪声的高光谱图像去噪变换器
IEEE Trans Neural Netw Learn Syst. 2024 Jul;35(7):8797-8811. doi: 10.1109/TNNLS.2022.3215751. Epub 2024 Jul 8.
6
Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial-Spectral Attention 3DCNN and a Transformer.利用高光谱成像结合增强空间-光谱注意力 3DCNN 和 Transformer 识别龟甲生长年。
Molecules. 2023 Sep 4;28(17):6427. doi: 10.3390/molecules28176427.
7
Dual-Stage Approach Toward Hyperspectral Image Super-Resolution.高光谱图像超分辨率的双阶段方法。
IEEE Trans Image Process. 2022;31:7252-7263. doi: 10.1109/TIP.2022.3221287. Epub 2022 Nov 23.
8
Deep Diversity-Enhanced Feature Representation of Hyperspectral Images.高光谱图像的深度多样性增强特征表示
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):8123-8138. doi: 10.1109/TPAMI.2024.3399753. Epub 2024 Nov 6.
9
Deep Posterior Distribution-Based Embedding for Hyperspectral Image Super-Resolution.基于深度后验分布的高光谱图像超分辨率嵌入
IEEE Trans Image Process. 2022;31:5720-5732. doi: 10.1109/TIP.2022.3201478. Epub 2022 Sep 2.
10
Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning.基于深度渐进零中心残差学习的高光谱图像超分辨率
IEEE Trans Image Process. 2021;30:1423-1438. doi: 10.1109/TIP.2020.3044214. Epub 2020 Dec 29.