Sharma Apoorav Maulik, Vig Renu, Dogra Ayush, Goyal Bhawna, Alkhayyat Ahmed, Kukreja Vinay, Saikia Manob Jyoti
UIET, Panjab University, Chandigarh, India.
Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura, Punjab, India.
Sci Rep. 2024 Jul 23;14(1):16987. doi: 10.1038/s41598-024-67502-y.
This manuscript introduces an innovative multi-stage image fusion framework that adeptly integrates infrared (IR) and visible (VIS) spectrum images to surmount the difficulties posed by low-light settings. The approach commences with an initial preprocessing stage, utilizing an Efficient Guided Image Filter for the infrared (IR) images to amplify edge boundaries and a function for the visible (VIS) images to boost local contrast and brightness. Utilizing a two-scale decomposition technique that incorporates Lipschitz constraints-based smoothing, the images are effectively divided into distinct base and detail layers, thereby guaranteeing the preservation of essential structural information. The process of fusion is carried out in two distinct stages: firstly, a method grounded in Bayesian theory is employed to effectively combine the base layers, so effectively addressing any inherent uncertainty. Secondly, a Surface from Shade (SfS) method is utilized to ensure the preservation of the scene's geometry by enforcing integrability on the detail layers. Ultimately a Choose Max principle is employed to determine the most prominent textural characteristics, resulting in the amalgamation of the base and detail layers to generate an image that exhibits a substantial enhancement in both clarity and detail. The efficacy of our strategy is substantiated by rigorous testing, showcasing notable progressions in edge preservation, detail enhancement, and noise reduction. Consequently, our method presents significant advantages for real-world applications in image analysis.
本手稿介绍了一种创新的多阶段图像融合框架,该框架巧妙地整合了红外(IR)和可见光(VIS)光谱图像,以克服低光照环境带来的困难。该方法首先是一个初始预处理阶段,对红外(IR)图像使用高效引导图像滤波器来放大边缘边界,对可见光(VIS)图像使用一个函数来增强局部对比度和亮度。利用一种结合基于利普希茨约束平滑的两尺度分解技术,图像被有效地划分为不同的基础层和细节层,从而保证了基本结构信息的保留。融合过程分两个不同阶段进行:首先,采用基于贝叶斯理论的方法有效地组合基础层,从而有效解决任何固有不确定性。其次,利用明暗恢复形状(SfS)方法,通过在细节层上强制可积性来确保场景几何形状的保留。最终采用最大选择原则来确定最突出的纹理特征,从而将基础层和细节层合并,生成一幅在清晰度和细节方面都有显著增强的图像。我们策略的有效性通过严格测试得到证实,在边缘保留、细节增强和降噪方面都有显著进展。因此,我们的方法在图像分析的实际应用中具有显著优势。