Title
Spectral Synthesis for Geostationary Satellite-to-Satellite Translation
Abstract
Earth-observing satellites carrying multispectral sensors are widely used to monitor the physical and biological states of the atmosphere, land, and oceans. These satellites have different vantage points above the Earth and different spectral imaging bands resulting in inconsistent imagery from one to another. This presents challenges in building downstream applications. What if we could generate synthetic bands for existing satellites from the union of all domains? We tackle the problem of generating synthetic spectral imagery for multispectral sensors as an unsupervised image-to-image translation problem modeled with a variational autoencoder (VAE) and generative adversarial network (GAN) architecture. Our approach introduces a novel shared spectral reconstruction loss to constrain the high-dimensional feature space of multispectral images. Simulated experiments performed by dropping one or more spectral bands show that cross-domain reconstruction outperforms measurements obtained from a second vantage point. Our proposed approach enables the synchronization of multispectral data and provides a basis for more homogeneous remote sensing datasets.
Year
DOI
Venue
2022
10.1109/TGRS.2021.3088686
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Keywords
DocType
Volume
Satellites, Sensors, Image reconstruction, NASA, Monitoring, Earth, Atmospheric measurements, Geophysical image processing, neural networks (NNs), remote sensing, unsupervised learning
Journal
60
ISSN
Citations 
PageRank 
0196-2892
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Thomas Vandal1184.40
Daniel J McDuff267261.67
Weile Wang3115.63
Kate Duffy411.07
Andrew Michaelis500.34
Ramakrishna R. Nemani601.01