Title
A CNN-Based Fusion Method for Feature Extraction from Sentinel Data.
Abstract
Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative is to benefit from weather-insensitive synthetic aperture radar (SAR) images. In many real-world applications, critical decisions are made based on some informative optical or radar features related to items such as water, vegetation or soil. Under cloudy conditions, however, optical-based features are not available, and they are commonly reconstructed through linear interpolation between data available at temporally-close time instants. In this work, we propose to estimate missing optical features through data fusion and deep-learning. Several sources of information are taken into accountoptical sequences, SAR sequences, digital elevation modelso as to exploit both temporal and cross-sensor dependencies. Based on these data and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May-November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baseline methods according to all performance indicators.
Year
DOI
Venue
2018
10.3390/rs10020236
REMOTE SENSING
Keywords
Field
DocType
coregistration,pansharpening,multi-sensor fusion,multitemporal images,deep learning,normalized difference vegetation index (NDVI)
Radar,Computer vision,Pattern recognition,Synthetic aperture radar,Convolutional neural network,Feature extraction,Sensor fusion,Normalized Difference Vegetation Index,Artificial intelligence,Linear interpolation,Deep learning,Geology
Journal
Volume
Issue
Citations 
10
2
4
PageRank 
References 
Authors
0.53
24
4
Name
Order
Citations
PageRank
Giuseppe Scarpa120423.23
Massimiliano Gargiulo241.20
Antonio Mazza341.20
Raffaele Gaetano411817.28