Title
Transforming Model Prediction for Tracking
Abstract
Optimization based tracking methods have been widely successful by integrating a target model prediction module, providing effective global reasoning by minimizing an objective function. While this inductive bias integrates valuable domain knowledge, it limits the expressivity of the tracking network. In this work, we therefore propose a tracker architecture employing a Transformer-based model prediction module. Transformers capture global relations with little inductive bias, allowing it to learn the prediction of more powerful target models. We further extend the model predictor to estimate a second set of weights that are applied for accurate bounding box regression. The resulting tracker ToMP relies on training and on test frame information in order to predict all weights transductively. We train the proposed tracker end-to-end and validate its performance by conducting comprehensive experiments on multiple tracking datasets. ToMP sets a new state of the art on three benchmarks, achieving an AUC of 68.5% on the challenging LaSOT [14] dataset. The code and trained models are available at https://github.com/visionml/pytracking
Year
DOI
Venue
2022
10.1109/CVPR52688.2022.00853
IEEE Conference on Computer Vision and Pattern Recognition
Keywords
DocType
Volume
Motion and tracking
Conference
2022
Issue
Citations 
PageRank 
1
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Christoph Mayer1514.53
Danelljan Martin2134449.35
Goutam Bhat332.41
Matthieu Paul401.01
Danda Pani Paudel500.68
Fisher Yu6128050.27
Luc Van Gool701.01