Suppr超能文献

基于残差注意力和多级特征编码的图像融合方法

Residual Attention-Based Image Fusion Method with Multi-Level Feature Encoding.

作者信息

Li Hao, Yang Tiantian, Wang Runxiang, Li Cuichun, Zhou Shuyu, Guo Xiqing

机构信息

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China.

University of Chinese Academy of Sciences, Beijing 100049, China.

出版信息

Sensors (Basel). 2025 Jan 24;25(3):717. doi: 10.3390/s25030717.

Abstract

This paper presents a novel image fusion method designed to enhance the integration of infrared and visible images through the use of a residual attention mechanism. The primary objective is to generate a fused image that effectively combines the thermal radiation information from infrared images with the detailed texture and background information from visible images. To achieve this, we propose a multi-level feature extraction and fusion framework that encodes both shallow and deep image features. In this framework, deep features are utilized as queries, while shallow features function as keys and values within a residual cross-attention module. This architecture enables a more refined fusion process by selectively attending to and integrating relevant information from different feature levels. Additionally, we introduce a dynamic feature preservation loss function to optimize the fusion process, ensuring the retention of critical details from both source images. Experimental results demonstrate that the proposed method outperforms existing fusion techniques across various quantitative metrics and delivers superior visual quality.

摘要

本文提出了一种新颖的图像融合方法,旨在通过使用残差注意力机制来增强红外图像和可见光图像的融合。主要目标是生成一幅融合图像,该图像能有效地将红外图像的热辐射信息与可见光图像的详细纹理和背景信息结合起来。为实现这一目标,我们提出了一个多级特征提取和融合框架,该框架对浅层和深层图像特征进行编码。在这个框架中,深层特征被用作查询,而浅层特征在残差交叉注意力模块中充当键和值。这种架构通过有选择地关注和整合来自不同特征层次的相关信息,实现了更精细的融合过程。此外,我们引入了一个动态特征保留损失函数来优化融合过程,确保保留来自两个源图像的关键细节。实验结果表明,所提出的方法在各种定量指标上优于现有融合技术,并具有卓越的视觉质量。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fe9/11821045/75d21e6af3e3/sensors-25-00717-g001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验