Centre for Intelligent Sensing, Queen Mary University of London, London, UK.
IEEE Trans Image Process. 2013 Apr;22(4):1354-61. doi: 10.1109/TIP.2012.2228497. Epub 2012 Nov 20.
The absence of a commonly adopted performance evaluation framework is hampering advances in the design of effective video trackers. In this paper, we present a single-score evaluation measure and a protocol to objectively compare trackers. The proposed measure evaluates tracking accuracy and failure, and combines them for both summative and formative performance assessment. The proposed protocol is composed of a set of trials that evaluate the robustness of trackers on a range of test scenarios representing several real-world conditions. The protocol is validated on a set of sequences with a diversity of targets (head, vehicle and person) and challenges (occlusions, background clutter, pose changes and scale changes) using six state-of-the-art trackers, highlighting their strengths and weaknesses on more than 187000 frames. The software implementing the protocol and the evaluation results are made available online and new results can be included, thus facilitating the comparison of trackers.
缺乏普遍采用的性能评估框架，阻碍了有效视频跟踪器设计的进展。在本文中，我们提出了一种单一评分的评估指标和协议，以客观地比较跟踪器。所提出的指标评估跟踪精度和失败，并将它们结合起来进行总结性和形成性的性能评估。所提出的协议由一组试验组成，这些试验在一系列测试场景中评估跟踪器的鲁棒性，这些场景代表了几种真实世界的情况。该协议在使用六个最先进的跟踪器的一系列具有多种目标（头部、车辆和人员）和挑战（遮挡、背景杂乱、姿势变化和比例变化）的序列上进行了验证，突出了它们在超过 187000 帧上的优缺点。实现协议和评估结果的软件可在线获得，并且可以包含新的结果，从而方便跟踪器的比较。
