Title
Visual object tracking performance measures revisited.
Abstract
The problem of visual tracking evaluation is sporting a large variety of performance measures, and largely suffers from lack of consensus about which measures should be used in experiments. This makes the cross-paper tracker comparison difficult. Furthermore, as some measures may be less effective than others, the tracking results may be skewed or biased toward particular tracking aspects. In this paper, we revisit the popular performance measures and tracker performance visualizations and analyze them theoretically and experimentally. We show that several measures are equivalent from the point of information they provide for tracker comparison and, crucially, that some are more brittle than the others. Based on our analysis, we narrow down the set of potential measures to only two complementary ones, describing accuracy and robustness, thus pushing toward homogenization of the tracker evaluation methodology. These two measures can be intuitively interpreted and visualized and have been employed by the recent visual object tracking challenges as the foundation for the evaluation methodology.
Year
DOI
Venue
2015
10.1109/TIP.2016.2520370
IEEE Transactions on Image Processing
Keywords
Field
DocType
Target tracking,Visualization,Performance evaluation,Object tracking,Current measurement,Robustness
Computer vision,Computer science,Visualization,Robustness (computer science),Video tracking,Eye tracking,Artificial intelligence,Machine learning
Journal
Volume
Issue
ISSN
25
3
1057-7149
Citations 
PageRank 
References 
35
0.96
40
Authors
3
Name
Order
Citations
PageRank
Luka Čehovin156018.04
Ales Leonardis21636147.33
Matej Kristan396047.02