Advances in real-time object tracking: Extensions for robust object tracking with a Monte Carlo particle filter.

The huge amount of literature on real-time object tracking continuously reports good results with respect to accuracy and robustness. However, when it comes to the applicability of these approaches to real-world problems, often no clear statements about the tracking situation can be made. This paper addresses this issue and relies on three novel extensions to Monte Carlo particle filtering. The first, , together with the second, , leads to faster convergence and a more accurate pose estimation. The third, removes jitter and ensures convergence. These extensions significantly increase robustness and accuracy, and further provide a basis for an algorithm we found to be essential for tracking systems performing in the real world: . Relying on the extensions above, it reports qualitative states of tracking as follows. indicates if the pose has already been found. gives a statement about the confidence of the currently tracked pose. detects when the algorithm fails. determines the degree of occlusion if only parts of the object are visible. Building on tracking state detection, a scheme is proposed as a measure of which views of the object have already been learned and which areas require further inspection. To the best of our knowledge, this is the first tracking system that explicitly addresses the issue of estimating the tracking state. Our open-source framework is available online, serving as an easy-access interface for usage in practice.