Title
Deep Generative Model for Spatial-Spectral Unmixing With Multiple Endmember Priors
Abstract
Spectral unmixing is an effective tool to mine information at the subpixel level from complex hyperspectral images. To consider the spatially correlated materials distributions in the scene, many algorithms unmix the data in a spatial-spectral fashion; however, existing models are usually unable to model spectral variability simultaneously. In this article, we present a variational autoencoder-based deep generative model for spatial-spectral unmixing (DGMSSU) with endmember variability, by linking the generated endmembers to the probability distributions of endmember bundles extracted from the hyperspectral imagery via discriminators. Besides the convolutional autoencoder-like architecture that can only model the spatial information within the regular patch inputs, DGMSSU is able to alternatively choose graph convolutional networks or self-attention mechanism modules to handle the irregular but more flexible data-superpixel. Experimental results on a simulated dataset, as well as two well-known real hyperspectral images, show the superiority of our proposed approach in comparison with other state-of-the-art spatial-spectral unmixing methods. Compared to the conventional unmixing methods that consider the endmember variability, our proposed model generates more accurate endmembers on each subimage by the adversarial training process. The codes of this work will be available at https://github.com/shuaikaishi/DGMSSU for the sake of reproducibility.
Year
DOI
Venue
2022
10.1109/TGRS.2022.3168712
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Keywords
DocType
Volume
Hyperspectral imaging, Decoding, Data models, Covariance matrices, Convolution, Atmospheric modeling, Linear matrix inequalities, Deep neural network, endmember variability, graph convolution, self-attention, spatial-spectral model, spectral unmixing
Journal
60
ISSN
Citations 
PageRank 
0196-2892
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Shuaikai Shi101.35
Lijun Zhang200.68
Yoann Altmann301.01
Jie Chen49138.15