Title
Painting style transfer for head portraits using convolutional neural networks.
Abstract
Head portraits are popular in traditional painting. Automating portrait painting is challenging as the human visual system is sensitive to the slightest irregularities in human faces. Applying generic painting techniques often deforms facial structures. On the other hand portrait painting techniques are mainly designed for the graphite style and/or are based on image analogies; an example painting as well as its original unpainted version are required. This limits their domain of applicability. We present a new technique for transferring the painting from a head portrait onto another. Unlike previous work our technique only requires the example painting and is not restricted to a specific style. We impose novel spatial constraints by locally transferring the color distributions of the example painting. This better captures the painting texture and maintains the integrity of facial structures. We generate a solution through Convolutional Neural Networks and we present an extension to video. Here motion is exploited in a way to reduce temporal inconsistencies and the shower-door effect. Our approach transfers the painting style while maintaining the input photograph identity. In addition it significantly reduces facial deformations over state of the art.
Year
DOI
Venue
2016
10.1145/2897824.2925968
ACM Trans. Graph.
Keywords
Field
DocType
NPAR,painting transfer,VGG,spatial constraints,Gatys,video,Gain maps,portrait,deformations
Computer vision,Portrait painting,Computer graphics (images),Human visual system model,Computer science,Convolutional neural network,Portrait,Painting,Artificial intelligence
Journal
Volume
Issue
ISSN
35
4
0730-0301
Citations 
PageRank 
References 
39
1.13
46
Authors
3
Name
Order
Citations
PageRank
Ahmed Selim1816.18
Mohamed A. Elgharib2769.98
Linda E. Doyle330434.70