Yuan Di, Shu Xiu, Liu Qiao, Zhang Xinming, He Zhenyu
Guangzhou Institute of Technology, Xidian University, Guangzhou, 510555 China.
School of Science, Harbin Institute of Technology, Shenzhen, 518055 China.
Neural Comput Appl. 2023;35(4):3423-3434. doi: 10.1007/s00521-022-07867-1. Epub 2022 Oct 12.
When dealing with complex thermal infrared (TIR) tracking scenarios, the single category feature is not sufficient to portray the appearance of the target, which drastically affects the accuracy of the TIR target tracking method. In order to address these problems, we propose an adaptively multi-feature fusion model (AMFT) for the TIR tracking task. Specifically, our AMFT tracking method adaptively integrates hand-crafted features and deep convolutional neural network (CNN) features. In order to accurately locate the target position, it takes advantage of the complementarity between different features. Additionally, the model is updated using a simple but effective model update strategy to adapt to changes in the target during tracking. In addition, a simple but effective model update strategy is adopted to adapt the model to the changes of the target during the tracking process. We have shown through ablation studies that the adaptively multi-feature fusion model in our AMFT tracking method is very effective. Our AMFT tracker performs favorably on PTB-TIR and LSOTB-TIR benchmarks compared with state-of-the-art trackers.
在处理复杂的热红外(TIR)跟踪场景时,单一类别特征不足以描绘目标的外观,这极大地影响了TIR目标跟踪方法的准确性。为了解决这些问题,我们针对TIR跟踪任务提出了一种自适应多特征融合模型(AMFT)。具体而言,我们的AMFT跟踪方法自适应地整合了手工特征和深度卷积神经网络(CNN)特征。为了准确地定位目标位置,它利用了不同特征之间的互补性。此外,该模型使用一种简单但有效的模型更新策略进行更新,以适应跟踪过程中目标的变化。我们通过消融研究表明,我们的AMFT跟踪方法中的自适应多特征融合模型非常有效。与最先进的跟踪器相比,我们的AMFT跟踪器在PTB-TIR和LSOTB-TIR基准测试中表现出色。