Paper Info
Title
Using Video Motion Vectors for Structure from Motion 3D Reconstruction
Abstract
H.264 video compression has become the prevalent choice for devices which require live video streaming and include mobile phones, laptops and Micro Aerial Vehicles (MAV). H.264 utilizes motion estimation to predict the distance of pixels, grouped together as macroblocks, between two or more video frames. Live video compression using H.264 is ideal as each frame contains much of the information found in previous and future frames. By estimating the motion vector of each macroblock for every frame, significant compression can be obtained. Combined with Socket on Chip (SoC) encoders, high quality video with low power and bandwidth is now achievable. 3D scene reconstruction utilizing structure from motion (SfM) is a highly computational intensive process, typically performed offline with high computing devices. A significant portion of the computation required for SfM is in the feature detection, matching and correspondence tracking necessary for the 3D scene reconstruction. We present a SfM pipeline which uses H.264 motion vectors to replace much of the processing required to detect, match and track correspondences across video frames. Our pipeline results have shown a significant decrease in computation, while accurately reconstructing a 3D scene.
Year
DOI
Venue
2022
10.5220/0011263600003289
SIGMAP: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS
Keywords
DocType
Citations 
H264, Structure from Motion, Motion Vectors, 3D Reconstruction
Conference
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Richard N. C. Turner100.34
Natasha Kholgade Banerjee233.09
Sean Banerjee300.68