Title
Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation
Abstract
Satellite images are often contaminated by clouds. Cloud removal has received special attention due to the wide range of satellite image applications. As the clouds thicken, the process of removing them becomes more challenging. In such cases, using auxiliary images, such as near-infrared or synthetic aperture radar (SAR), for reconstructing is common. In this study, we attempt to solve the problem using two generative adversarial networks (GANs): the first translates SAR images to optical images and the second removes clouds using the translated images of prior GAN. Also, we propose dilated residual inception blocks (DRIBs) instead of vanilla U-net in the generator networks and use structural similarity index measure (SSIM) in addition to the L1 loss function. Reducing the number of downsamplings and expanding receptive fields by dilated convolutions increased the quality of output images. We used the SEN1-2 dataset to train and test both GANs, and we made cloudy images by adding synthetic clouds to optical images. In addition, we used the SEN12MS-CR dataset to test network performance to remove real clouds. The restored images are evaluated using PSNR, SSIM, SAM, MAE, RMSE, and Q. We compared the proposed method with state-of-the-art deep learning models and achieved more accurate results in both SAR-to-optical image translation and cloud removal parts.
Year
DOI
Venue
2022
10.1109/TGRS.2021.3131035
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Keywords
DocType
Volume
Clouds, Generative adversarial networks, Optical imaging, Generators, Optical sensors, Synthetic aperture radar, Radar polarimetry, Cloud removal, deep learning, generative adversarial network (GAN), optical imagery, SAR-to-optical translation, synthetic aperture radar (SAR)
Journal
60
ISSN
Citations 
PageRank 
0196-2892
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Faramarz Naderi Darbaghshahi100.34
Mohammad Reza Mohammadi2266.71
Mohsen Soryani300.34