Title
GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes.
Abstract
We present an algorithm that learns a coarse 3D representation of objects from unposed multi-view 2D mask supervision, then uses it to generate detailed mask and image texture. In contrast to existing voxel-based methods for unposed object reconstruction, our approach learns to represent the generated shape and pose with a set of self-supervised canonical 3D anisotropic Gaussians via a perspective camera, and a set of per-image transforms. We show that this approach can robustly estimate a 3D space for the camera and object, while recent baselines sometimes struggle to reconstruct coherent 3D spaces in this setting. We show results on synthetic datasets with realistic lighting, and demonstrate object insertion with interactive posing. With our work, we help move towards structured representations that handle more real-world variation in learning-based object reconstruction.
Year
Venue
DocType
2021
British Machine Vision Conference
Conference
Citations 
PageRank 
References 
0
0.34
0
Authors
6
Name
Order
Citations
PageRank
Youssef A. Mejjati171.10
Isa Milefchik200.34
Aaron Gokaslan353.13
Oliver Wang401.69
Kwang In Kim500.34
James Tompkin633125.38