Title
Dual L1-Normalized Context Aware Tensor Power Iteration and Its Applications to Multi-object Tracking and Multi-graph Matching
Abstract
The multi-dimensional assignment problem is universal for data association analysis such as data association-based visual multi-object tracking and multi-graph matching. In this paper, multi-dimensional assignment is formulated as a rank-1 tensor approximation problem. A dual L1-normalized context/hyper-context aware tensor power iteration optimization method is proposed. The method is applied to multi-object tracking and multi-graph matching. In the optimization method, tensor power iteration with the dual unit norm enables the capture of information across multiple sample sets. Interactions between sample associations are modeled as contexts or hyper-contexts which are combined with the global affinity into a unified optimization. The optimization is flexible for accommodating various types of contextual models. In multi-object tracking, the global affinity is defined according to the appearance similarity between objects detected in different frames. Interactions between objects are modeled as motion contexts which are encoded into the global association optimization. The tracking method integrates high order motion information and high order appearance variation. The multi-graph matching method carries out matching over graph vertices and structure matching over graph edges simultaneously. The matching consistency across multi-graphs is based on the high-order tensor optimization. Various types of vertex affinities and edge/hyper-edge affinities are flexibly integrated. Experiments on several public datasets, such as the MOT16 challenge benchmark, validate the effectiveness of the proposed methods.
Year
DOI
Venue
2020
10.1007/s11263-019-01231-y
International Journal of Computer Vision
Keywords
DocType
Volume
Multi-dimensional assignment, Context/hyper-context aware tensor power iteration, Multi-object tracking, Multi-graph matching
Journal
128
Issue
ISSN
Citations 
2
0920-5691
1
PageRank 
References 
Authors
0.36
18
6
Name
Order
Citations
PageRank
Weiming Hu15300261.38
Xinchu Shi21677.22
Zongwei Zhou31488.75
Junliang Xing4119363.31
Haibin Ling54531215.76
Stephen J. Maybank64105493.12