Title
Arbitrary style transfer with attentional networks via unbalanced optimal transport
Abstract
Arbitrary style transfer aims to stylize the content image with the style image. The key problem of style transfer is how to balance the global content structure and the local style patterns. A promising method to solve this problem is the attentional style transfer method, where a learnable embedding of image features enables style patterns to be flexibly recombined with the content image, so local style patterns will be well preserved in the stylized image. However, current attentional style transfer methods cannot well preserve the global content structure. To solve this problem, a novel attentional style transfer network is proposed, that relies on Optimal Transport (OT) for computing the attention map. The proposed OT-based attention ensures the similarity between global distributions of the synthesized image and its corresponding style image. For the optimal transport computation, a regularized formulation is used, which not only allows an unbalanced optimal transport to address the deviational distributions but also improves the robustness of stylized results. The proposed method finds a well balance between the global content structure and local style patterns. Various experiments are conducted to demonstrate the superiority of the proposed method over state-of-the-art methods.
Year
DOI
Venue
2022
10.1049/ipr2.12403
IET IMAGE PROCESSING
DocType
Volume
Issue
Journal
16
7
ISSN
Citations 
PageRank 
1751-9659
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Jie Li101.69
Liwen Wu202.70
Dan Xu320152.67
Shaowen Yao48626.85