Title
3D model silhouette-based tracking in depth images for puppet suit dynamic video-mapping.
Abstract
Video-mapping is the process of coherent video-projection of images, animations or movies on static objects or buildings for shows. This paper focuses on the dynamic video-mapping of the suit of a puppet being moved by its puppeteer on the theater stage. This may allow changing the costume dynamically and simulate light interaction and more. Contrary to common video-mapping, the image warping cannot be done once, offline, before the show. It must be done in real-time, and considering a non-flat projection surface, so that the video-projected suit always maps perfectly the puppet, automatically. Hence, we propose a new visual tracking method of articulated object, for the puppet tracking, exploiting the silhouette of a 3D model of it, in the depth images of a Kinect v2. Then, considering the precise calibration between the latter and the video-projector, that we propose, coherent dynamic video-mapping is made possible as the presented results show.
Year
Venue
Field
2018
arXiv: Computer Vision and Pattern Recognition
Computer vision,Image warping,Pattern recognition,Computer science,Silhouette,Eye tracking,Artificial intelligence,Calibration
DocType
Volume
Citations 
Journal
abs/1810.03956
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Guillaume Caron100.34
Mounya Belghiti200.34
Anthony Dessaux300.34