Name
Title | ||
|---|---|---|
Multi-modal image synthesis combining content-style adaptive normalization and attentive normalization |
Abstract | ||
|---|---|---|
AbstractHighlights •We propose a new unsupervised image translation model with novel adaptive normalization function (CSAN) and Attentive Normalization (AN).•Combined with Instance Normalization (IN) and Group Normalization (GN), CSAN can help the attention mechanism to flexibly control the amount of change in texture and shape of input images without changing the model architecture and hyperparameters. The learnable affne transformation parameters in CSAN are dependent style codes as well as content codes, which is helpful to deal with the problem of content loss.•Attentive normalization(AN)canbettermodellong-range dependency in conditional image generation, which facilitates our model to learn where to transform violently by differentiating between source and target domains. Graphical abstractDisplay OmittedAbstractWe propose a novel unsupervised image translation model following an end-to-end manner,which incorporates Content-Style Adaptive Normalization(CSAN) and Attentive Normalization(AN). First of all, a new attentive normalization is applied for the first time in the style transfer task, which is an improvement and supplement to the traditional instance normalization, it helps to guide the model to pay more attention to the key areas in image translation, while ignoring the secondary areas. Secondly, our proposed CSAN function absorbs not only information of style codes, but also that of content codes. Compared with Adaptive Instance Normalization(AdaIN), CSAN is more favorable to retain content information of input images. In addition, CSAN can help the attention mechanism to flexibly control the amount of change in texture and shape of input images. Finally, a series of comparative experiments and qualitative and quantitative evaluations on the challenging datasets prove that the proposed model is superior and more advanced than State-Of-The-Art(SOTA) in terms of visual quality, diversity,semantic integrity, and style reflection of generated images. |
Year | DOI | Venue |
|---|---|---|
2021 | 10.1016/j.cag.2021.04.030 | Periodicals |
Keywords | DocType | Volume |
Unsupervised image translation, Content-style adaptive normalization, Attention mechanism, Adaptive instance normalization, Style code, Content code | Journal | 98 |
Issue | ISSN | Citations |
C | 0097-8493 | 0 |
PageRank | References | Authors |
0.34 | 0 | 6 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Heng Zhang | 1 | 0 | 0.34 |
| Yuanyuan Pu | 2 | 0 | 2.37 |
| Rencan Nie | 3 | 0 | 0.68 |
| Dan Xu | 4 | 201 | 52.67 |
| Zhengpeng Zhao | 5 | 0 | 1.35 |
| Wenhua Qian | 6 | 2 | 6.11 |