Title
Collaging on Internal Representations: An Intuitive Approach for Semantic Transfiguration.
Abstract
We present a novel CNN-based image editing method that allows the user to the semantic information of an image over a user-specified region. Our method makes this possible by combining the idea of manifold projection with spatial conditional batch normalization (sCBN), a version of conditional batch normalization with user-specifiable spatial weight maps. With sCBN and manifold projection, our method lets the user perform (1) spatial class translation that changes the class of an object over an arbitrary region of useru0027s choice, and (2) semantic transplantation that transplants semantic information contained in an arbitrary region of the reference image to an arbitrary region in the target image. These two transformations can be used simultaneously, and can realize a complex composite image-editing task like change the nose of a beagle to that of a bulldog, and open her mouth. The user can also use our method with intuitive copy-paste-style manipulations. We demonstrate the power of our method on various images. Code will be available at this https URL.
Year
Venue
DocType
2018
arXiv: Computer Vision and Pattern Recognition
Journal
Volume
Citations 
PageRank 
abs/1811.10153
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Ryohei Suzuki18711.10
Masanori Koyama21957.37
Takeru Miyato342213.62
Taizan Yonetsuji472.72