• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于单目标跟踪的具有全局相关性的轻量级暹罗网络。

Lightweight Siamese Network with Global Correlation for Single-Object Tracking.

作者信息

Ding Yuxuan, Miao Kehua

机构信息

Department of Automation, Xiamen University, Xiamen 361102, China.

出版信息

Sensors (Basel). 2024 Dec 21;24(24):8171. doi: 10.3390/s24248171.

DOI:10.3390/s24248171
PMID:39771906
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11679318/
Abstract

Recent advancements in the field of object tracking have been notably influenced by Siamese-based trackers, which have demonstrated considerable progress in their performance and application. Researchers frequently emphasize the precision of trackers, yet they tend to neglect the associated complexity. This oversight can restrict real-time performance, rendering these trackers inadequate for specific applications. This study presents a novel lightweight Siamese network tracker, termed SiamGCN, which incorporates global feature fusion alongside a lightweight network architecture to improve tracking performance on devices with limited resources. MobileNet-V3 was chosen as the backbone network for feature extraction, with modifications made to the stride of its final layer to enhance extraction efficiency. A global correlation module, which was founded on the Transformer architecture, was developed utilizing a multi-head cross-attention mechanism. This design enhances the integration of template and search region features, thereby facilitating more precise and resilient tracking capabilities. The model underwent evaluation across four prominent tracking benchmarks: VOT2018, VOT2019, LaSOT, and TrackingNet. The results indicate that SiamGCN achieves high tracking performance while simultaneously decreasing the number of parameters and computational costs. This results in significant benefits regarding processing speed and resource utilization.

摘要

基于暹罗网络的跟踪器对目标跟踪领域的最新进展产生了显著影响,这些跟踪器在性能和应用方面都取得了长足的进步。研究人员经常强调跟踪器的精度,但往往忽略了其相关的复杂性。这种疏忽可能会限制实时性能,使这些跟踪器在特定应用中表现不佳。本研究提出了一种新型的轻量级暹罗网络跟踪器,称为SiamGCN,它结合了全局特征融合和轻量级网络架构,以提高在资源有限的设备上的跟踪性能。选择MobileNet-V3作为特征提取的主干网络,并对其最后一层的步长进行了修改,以提高提取效率。基于Transformer架构开发了一个全局相关模块,利用多头交叉注意力机制。这种设计增强了模板和搜索区域特征的整合,从而促进了更精确和更具弹性的跟踪能力。该模型在四个著名的跟踪基准上进行了评估:VOT2018、VOT2019、LaSOT和TrackingNet。结果表明,SiamGCN在实现高跟踪性能的同时,减少了参数数量和计算成本。这在处理速度和资源利用方面带来了显著优势。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/de27f12ef65e/sensors-24-08171-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/7bef86ce7b55/sensors-24-08171-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/4ef3750d2f45/sensors-24-08171-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/bd1fa50e1b63/sensors-24-08171-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/fe02815d7a24/sensors-24-08171-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/552588a818bf/sensors-24-08171-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/36a2f65766b6/sensors-24-08171-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/a84bf11b9083/sensors-24-08171-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/de27f12ef65e/sensors-24-08171-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/7bef86ce7b55/sensors-24-08171-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/4ef3750d2f45/sensors-24-08171-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/bd1fa50e1b63/sensors-24-08171-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/fe02815d7a24/sensors-24-08171-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/552588a818bf/sensors-24-08171-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/36a2f65766b6/sensors-24-08171-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/a84bf11b9083/sensors-24-08171-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3139/11679318/de27f12ef65e/sensors-24-08171-g008.jpg

相似文献

1
Lightweight Siamese Network with Global Correlation for Single-Object Tracking.用于单目标跟踪的具有全局相关性的轻量级暹罗网络。
Sensors (Basel). 2024 Dec 21;24(24):8171. doi: 10.3390/s24248171.
2
EMAT: Efficient feature fusion network for visual tracking via optimized multi-head attention.EMAT:通过优化多头注意力进行视觉跟踪的高效特征融合网络。
Neural Netw. 2024 Apr;172:106110. doi: 10.1016/j.neunet.2024.106110. Epub 2024 Jan 6.
3
Siamese hierarchical feature fusion transformer for efficient tracking.用于高效跟踪的暹罗层次特征融合变压器
Front Neurorobot. 2022 Dec 1;16:1082346. doi: 10.3389/fnbot.2022.1082346. eCollection 2022.
4
Learning Geometry Information of Target for Visual Object Tracking with Siamese Networks.利用连体网络学习视觉目标跟踪中目标的几何信息。
Sensors (Basel). 2021 Nov 23;21(23):7790. doi: 10.3390/s21237790.
5
HROM: Learning High-Resolution Representation and Object-Aware Masks for Visual Object Tracking.HROM:用于视觉目标跟踪的学习高分辨率表示和对象感知掩模。
Sensors (Basel). 2020 Aug 26;20(17):4807. doi: 10.3390/s20174807.
6
CTT: CNN Meets Transformer for Tracking.CTT:CNN 与 Transformer 结合的目标跟踪方法。
Sensors (Basel). 2022 Apr 22;22(9):3210. doi: 10.3390/s22093210.
7
Correlation-Embedded Transformer Tracking: A Single-Branch Framework.关联嵌入Transformer跟踪:单分支框架
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):10681-10696. doi: 10.1109/TPAMI.2024.3448254. Epub 2024 Nov 6.
8
Adaptive sparse attention-based compact transformer for object tracking.用于目标跟踪的基于自适应稀疏注意力的紧凑型变压器
Sci Rep. 2024 May 28;14(1):12256. doi: 10.1038/s41598-024-63028-5.
9
Siamese Implicit Region Proposal Network With Compound Attention for Visual Tracking.基于复合注意力的暹罗隐式区域提案网络的视觉跟踪。
IEEE Trans Image Process. 2022;31:1882-1894. doi: 10.1109/TIP.2022.3148876. Epub 2022 Feb 16.
10
CVTrack: Combined Convolutional Neural Network and Vision Transformer Fusion Model for Visual Tracking.CVTrack:用于视觉跟踪的卷积神经网络与视觉Transformer融合模型
Sensors (Basel). 2024 Jan 3;24(1):274. doi: 10.3390/s24010274.

本文引用的文献

1
SiamMask: A Framework for Fast Online Object Tracking and Segmentation.暹罗面具:一种用于快速在线目标跟踪和分割的框架。
IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):3072-3089. doi: 10.1109/TPAMI.2022.3172932.
2
GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild.GOT-10k:用于野外通用目标跟踪的大型高多样性基准数据集。
IEEE Trans Pattern Anal Mach Intell. 2021 May;43(5):1562-1577. doi: 10.1109/TPAMI.2019.2957464. Epub 2021 Apr 1.