Title | ||
---|---|---|
Stylistic scene enhancement GAN: mixed stylistic enhancement generation for 3D indoor scenes. |
Abstract | ||
---|---|---|
In this paper, we present stylistic scene enhancement GAN, SSE-GAN, a conditional Wasserstein GAN-based approach to automatic generation of mixed stylistic enhancements for 3D indoor scenes. An enhancement indicates factors that can influence the style of an indoor scene such as furniture colors and occurrence of small objects. To facilitate network training, we propose a novel enhancement feature encoding method, which represents an enhancement by a multi-one-hot vector, and effectively accommodates different enhancement factors. A Gumbel-Softmax module is introduced in the generator network to enable the generation of high fidelity enhancement features that can better confuse the discriminator. Experiments show that our approach is superior to the other baseline methods and successfully models the relationship between the style distribution and scene enhancements. Thus, although only trained with a dataset of room images in single styles, the trained generator can generate mixed stylistic enhancements by specifying multiple styles as the condition. Our approach is the first to apply a Gumbel-Softmax module in conditional Wasserstein GANs, as well as the first to explore the application of GAN-based models in the scene enhancement field. |
Year | DOI | Venue |
---|---|---|
2019 | 10.1007/s00371-019-01691-w | The Visual Computer |
Keywords | Field | DocType |
Scene enhancement, 3D indoor scenes, Interior design, Conditional generative adversarial nets, Gumbel-Softmax, Multi-one-hot | High fidelity,Computer vision,Discriminator,Computer science,Interior design,Artificial intelligence,Encoding (memory) | Journal |
Volume | Issue | ISSN |
35 | 6 | 0178-2789 |
Citations | PageRank | References |
5 | 0.63 | 0 |
Authors | ||
5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Suiyun Zhang | 1 | 9 | 1.72 |
Han Zhizhong | 2 | 198 | 18.28 |
Yu-Kun Lai | 3 | 1025 | 80.48 |
Zwicker Matthias | 4 | 2513 | 129.25 |
Hui Zhang | 5 | 188 | 24.25 |