Title
Virtual Try-On Network With Attribute Transformation And Local Rendering
Abstract
A virtual try-on network has gradually become a popular topic in recent years. It aims to transfer images of in-shop clothes onto the image of a target person. Owing to the diversity of clothing attributes, developing an image-based virtual try-on network is a complicated task for computers to perform and requires significant effort. Existing methods are unsatisfactory as they cannot preserve the characteristics of the clothes or the target person's identity well, thereby affecting the perception of the generated images; therefore, further research is required. To address this problem, we propose a novel try-on method that combines attribute transformation and local rendering. First, we employ pixel-level semantic segmentation to identify the try-on area and provide implementation conditions for local rendering. Second, we construct a learnable attribute transformation module to complete the try-on task for different attributes. Third, we use a learnable clothing warping module to fit the pose and figure of the target person well and establish a novel loss function, called modified style loss (M-SL), to handle clothes with rich details. Finally, we adopt a local rendering strategy, using which only renders the clothing area to ensure that the details of the non-target area are not lost. Extensive experiments are performed to test our method. The results demonstrate that our method outperforms other state-of-the-art methods.
Year
DOI
Venue
2021
10.1109/TMM.2021.3070972
IEEE TRANSACTIONS ON MULTIMEDIA
Keywords
DocType
Volume
Clothing, Rendering (computer graphics), Three-dimensional displays, Task analysis, Two dimensional displays, Shape, Gallium nitride, Attribute transformation, computer vision, generative adversarial networks, local rendering, semantic segmentation, virtual try-on
Journal
23
ISSN
Citations 
PageRank 
1520-9210
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Jun Xu111.64
Yuanyuan Pu202.37
Rencan Nie34610.43
Dan Xu420152.67
Zhengpeng Zhao501.35
Wenhua Qian626.11