Title
Multi-view and 3D Deformable Part Models
Abstract
As objects are inherently 3-dimensional, they have been modeled in 3D in the early days of computer vision. Due to the ambiguities arising from mapping 2D features to 3D models, 3D object representations have been neglected and 2D feature-based models are the predominant paradigm in object detection nowadays. While such models have achieved outstanding bounding box detection performance, they come with limited expressiveness, as they are clearly limited in their capability of reasoning about 3D shape or viewpoints. In this work, we bring the worlds of 3D and 2D object representations closer, by building an object detector which leverages the expressive power of 3D object representations while at the same time can be robustly matched to image evidence. To that end, we gradually extend the successful deformable part model [1] to include viewpoint information and part-level 3D geometry information, resulting in several different models with different level of expressiveness. We end up with a 3D object model, consisting of multiple object parts represented in 3D and a continuous appearance model. We experimentally verify that our models, while providing richer object hypotheses than the 2D object models, provide consistently better joint object localization and viewpoint estimation than the state-of-the-art multi-view and 3D object detectors on various benchmarks (KITTI [2], 3D object classes [3], Pascal3D+ [4], Pascal VOC 2007 [5], EPFL multi-view cars [6]).
Year
DOI
Venue
2015
10.1109/TPAMI.2015.2408347
Pattern Analysis and Machine Intelligence, IEEE Transactions  
Keywords
Field
DocType
3d object models,object detection,deformable part models,structured output learning,detectors,feature extraction,solid modeling,geometry
Computer vision,Object detection,Method,Computer science,Object model,Active appearance model,Feature extraction,Artificial intelligence,Solid modeling,Detector,Minimum bounding box
Journal
Volume
Issue
ISSN
PP
99
0162-8828
Citations 
PageRank 
References 
25
1.16
51
Authors
4
Name
Order
Citations
PageRank
Bojan Pepik1875.12
Michael Stark273726.80
Peter Gehler3136361.64
Bernt Schiele412901971.29