School of Electronic and Information Engineering, Xi'an Technological University, Xi'an 710021, China.
Sensors (Basel). 2022 Oct 2;22(19):7494. doi: 10.3390/s22197494.
In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion.
为了解决将红外和可见光图像融合反晕光方法直接应用于视频时出现的不连续性问题，提出了一种基于视频融合的高效夜视反晕光方法。所设计的基于帧间差的帧选择通过分析余弦角度阈值与非线性相关信息熵和去帧率之间的关系来确定最佳余弦角度阈值。所提出的基于时间标记的自适应运动补偿通过保留帧数作为时间戳，构建与冗余帧数相同数量的插值帧数。同时，考虑到两个相邻保留帧的运动向量作为基准，根据插值帧与最后一个保留帧之间的帧间差构建自适应权重，然后估计插值帧的运动向量。实验结果表明，所提出的帧选择策略在不同晕光场景下不同车速的连续视频内容前提下，保证了最大安全帧的去除。融合视频的帧数和播放时长与原始视频一致，并且插值帧的内容与相应的原始帧高度同步。与逐帧融合相比，这项工作中的视频融合的平均帧率约为其六倍，有效地提高了视频融合的反晕光处理效率。
