Title
Classification and Pose Estimation of Vehicles in Videos by 3D Modeling within Discrete-Continuous Optimization
Abstract
This paper presents a framework for classification and pose estimation of vehicles in videos by assuming their given 3D models. We rank possible poses and types for each frame and exploit temporal coherence between consecutive frames for refinement. As a novelty, first, we cast the estimation of a vehicle's pose and type as a solution of a continuous optimization problem over space and time. Due to a non-convexity of this problem, good initial starting points are important. We propose to obtain them by a discrete temporal optimization reaching a global optimum on a ranked discrete set of possible types and poses. Second, to guarantee effectiveness of the proposed discrete-continuous optimization, we present a novel way to efficiently reduce the search space of potential 3D model types and poses for each frame for the discrete optimizer. It avoids common expensive evaluation of all possible discretized hypotheses. The key idea towards efficiency lies in a novel combination of detecting the vehicle, rendering the 3D models, matching projected edges to input images, and using a tree structured Markov Random Field to get fast and globally optimal inference and to force the vehicle follow a feasible motion model in the initial phase. Quantitative and qualitative experiments on a variety of videos with vast variation of vehicle types show superior results to state-of-the-art methods.
Year
DOI
Venue
2012
10.1109/3DIMPVT.2012.23
3DIMPVT
Keywords
Field
DocType
consecutive frame,continuous optimization problem,discrete set,discrete optimizer,feasible motion model,proposed discrete-continuous optimization,discrete-continuous optimization,possible type,pose estimation,discrete temporal optimization,vehicle type,possible discretized hypothesis,image classification,markov processes
Continuous optimization,Discretization,Computer vision,Markov process,Markov random field,Computer science,3D pose estimation,Algorithm,Pose,Artificial intelligence,Contextual image classification,Rendering (computer graphics)
Conference
ISBN
Citations 
PageRank 
978-1-4673-4470-8
1
0.36
References 
Authors
0
5
Name
Order
Citations
PageRank
Michael Hodlmoser1182.81
Branislav Micusik2303.98
Ming-Yu Liu387235.44
Marc Pollefeys47671475.90
Martin Kampel535141.10