Name
Title | ||
|---|---|---|
Multi-Task Structure-aware Context Modeling for Robust Keypoint-based Object Tracking. |
Abstract | ||
|---|---|---|
In the fields of computer vision and graphics, keypoint-based object tracking is a fundamental and challenging problem, which is typically formulated in a spatio-temporal context modeling framework. However, many existing keypoint trackers are incapable of effectively modeling and balancing the following three aspects in a simultaneous manner: temporal model coherence across frames, spatial model consistency within frames, and discriminative feature construction. To address this problem, we propose a robust keypoint tracker based on spatio-temporal multi-task structured output optimization driven by discriminative metric learning. Consequently, temporal model coherence is characterized by multi-task structured keypoint model learning over several adjacent frames; spatial model consistency is modeled by solving a geometric verification based structured learning problem; discriminative feature construction is enabled by metric learning to ensure the intra-class compactness and inter-class separability. To achieve the goal of effective object tracking, we jointly optimize the above three modules in a spatio-temporal multi-task learning scheme. Furthermore, we incorporate this joint learning scheme into both single-object and multi-object tracking scenarios, resulting in robust tracking results. Experiments over several challenging datasets have justified the effectiveness of our single-object and multi-object trackers against the state-of-the-art. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/TPAMI.2018.2818132 | IEEE transactions on pattern analysis and machine intelligence |
Keywords | Field | DocType |
Object tracking,Task analysis,Robustness,Computational modeling,Coherence,Feature extraction | Graphics,Computer vision,Multi-task learning,Computer science,Structured prediction,Robustness (computer science),Feature extraction,Context model,Video tracking,Artificial intelligence,Discriminative model | Journal |
Volume | Issue | ISSN |
41 | 4 | 1939-3539 |
Citations | PageRank | References |
1 | 0.35 | 38 |
Authors | ||
8 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xi Li | 1 | 4 | 3.08 |
| Liming Zhao | 2 | 175 | 6.01 |
| Wei Ji | 3 | 11 | 6.78 |
| Yiming Wu | 4 | 3 | 1.39 |
| Fei Wu | 5 | 2209 | 153.88 |
| Yang Ming-Hsuan | 6 | 15303 | 620.69 |
| Dacheng Tao | 7 | 19032 | 747.78 |
| Ian D. Reid | 8 | 5864 | 364.59 |