Title
Domain Adaptation With Foreground/Background Cues and Gated Discriminators
Abstract
Self-driving cars leverage on semantic segmentation to understand an urban scene. However, it is costly to collect segmentation labels, thus, synthetic datasets are used to train segmentation models. Unfortunately, the synthetic to real domain shift causes these models to perform poorly. Prior works use adversarial training to align features of both synthetic and real-world images. We observe that background objects tend to be similar across domains, while foreground objects tend to have more variations. Using this insight, we propose an adaptation method that uses foreground and background cues and adapt them separately. We also propose a mask-aware gated discriminator that learns soft masks from the input foreground and background masks instead of naively performing binary masking that immediately removes information outside of the predicted masks. We evaluate our method on two different datasets and show that our method outperforms several state-of-the-art baselines, which verifies the effectiveness of our approach.
Year
DOI
Venue
2020
10.1109/MMUL.2020.3008529
IEEE MultiMedia
Keywords
DocType
Volume
background cues,mask-aware gated discriminator,background masks,binary masking,domain adaptation,self-driving cars,urban scene,segmentation labels,synthetic datasets,adversarial training,background objects,foreground objects,adaptation method,semantic segmentation models,foreground cues
Journal
27
Issue
ISSN
Citations 
3
1070-986X
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Yong-Xiang Lin161.17
Daniel Stanley Tan2165.04
Yung-Yao Chen367.92
Ching-Chun Huang474.91
Kai-Lung Hua526542.99