College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China.
Shenzhen Research Institute, Nanjing University of Aeronautics and Astronautics, Shenzhen 518063, China.
Sensors (Basel). 2021 Dec 22;22(1):40. doi: 10.3390/s22010040.
As a powerful technique to merge complementary information of original images, infrared (IR) and visible image fusion approaches are widely used in surveillance, target detecting, tracking, and biological recognition, etc. In this paper, an efficient IR and visible image fusion method is proposed to simultaneously enhance the significant targets/regions in all source images and preserve rich background details in visible images. The multi-scale representation based on the fast global smoother is firstly used to decompose source images into the base and detail layers, aiming to extract the salient structure information and suppress the halos around the edges. Then, a target-enhanced parallel Gaussian fuzzy logic-based fusion rule is proposed to merge the base layers, which can avoid the brightness loss and highlight significant targets/regions. In addition, the visual saliency map-based fusion rule is designed to merge the detail layers with the purpose of obtaining rich details. Finally, the fused image is reconstructed. Extensive experiments are conducted on 21 image pairs and a Nato-camp sequence (32 image pairs) to verify the effectiveness and superiority of the proposed method. Compared with several state-of-the-art methods, experimental results demonstrate that the proposed method can achieve more competitive or superior performances according to both the visual results and objective evaluation.
作为一种融合原始图像互补信息的强大技术，红外（IR）和可见图像融合方法广泛应用于监控、目标检测、跟踪和生物识别等领域。本文提出了一种有效的红外和可见图像融合方法，旨在同时增强所有源图像中的显著目标/区域，并保留可见图像中的丰富背景细节。该方法首先基于快速全局平滑器的多尺度表示将源图像分解为基础层和细节层，旨在提取显著结构信息并抑制边缘周围的晕影。然后，提出了一种基于目标增强的并行高斯模糊逻辑融合规则来融合基础层，该规则可以避免亮度损失并突出显著目标/区域。此外，设计了基于视觉显著性图的融合规则来融合细节层，以获得丰富的细节。最后，重建融合图像。在 21 对图像和 Nato-camp 序列（32 对图像）上进行了广泛的实验，以验证所提出方法的有效性和优越性。与几种最先进的方法相比，实验结果表明，根据视觉效果和客观评价，所提出的方法可以获得更具竞争力或更优的性能。
