Kalman Filtering and Expectation Maximization for Multitemporal Spectral Unmixing

The recent evolution of hyperspectral imaging technology and the proliferation of new emerging applications presses for the processing of multiple temporal hyperspectral images. In this work, we propose a novel spectral unmixing (SU) strategy using physically motivated parametric endmember representations to account for temporal spectral variability. By representing the multitemporal mixing process using a state-space formulation, we are able to exploit the Bayesian filtering machinery to estimate the endmember variability coefficients. Moreover, by assuming that the temporal variability of the abundances is small over short intervals, an efficient implementation of the expectation maximization (EM) algorithm is employed to estimate the abundances and the other model parameters. Simulation results indicate that the proposed strategy outperforms state-of-the-art multitemporal SU algorithms.

[1]  Jocelyn Chanussot,et al.  Blind Hyperspectral Unmixing Using an Extended Linear Mixing Model to Address Spectral Variability , 2016, IEEE Transactions on Image Processing.

[2]  Jean-Yves Tourneret,et al.  Hyperspectral Unmixing With Spectral Variability Using a Perturbed Linear Mixing Model , 2015, IEEE Transactions on Signal Processing.

[3]  Ricardo Augusto Borsoi,et al.  Improved Hyperspectral Unmixing with Endmember Variability Parametrized Using an Interpolated Scaling Tensor , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Jean-Yves Tourneret,et al.  A Hierarchical Bayesian Model Accounting for Endmember Variability and Abrupt Spectral Changes to Unmix Multitemporal Hyperspectral Images , 2016, IEEE Transactions on Computational Imaging.

[5]  Cédric Richard,et al.  A Fast Multiscale Spatial Regularization for Sparse Hyperspectral Unmixing , 2017, IEEE Geoscience and Remote Sensing Letters.

[6]  Cédric Richard,et al.  Nonparametric Detection of Nonlinearly Mixed Pixels and Endmember Estimation in Hyperspectral Images , 2015, IEEE Transactions on Image Processing.

[7]  Lloyd L. Coulter,et al.  Multidate MESMA for monitoring vegetation growth forms in southern California shrublands , 2018 .

[8]  Ricardo Augusto Borsoi,et al.  Generalized Linear Mixing Model Accounting for Endmember Variability , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Ben Somers,et al.  Multi-temporal hyperspectral mixture analysis and feature selection for invasive species mapping in rainforests , 2013 .

[10]  Davide Spinello,et al.  Nonlinear Estimation With State-Dependent Gaussian Observation Noise , 2010, IEEE Transactions on Automatic Control.

[11]  David Mary,et al.  Blind and Fully Constrained Unmixing of Hyperspectral Images , 2014, IEEE Transactions on Image Processing.

[12]  Gregory Asner,et al.  Invasive Species Mapping in Hawaiian Rainforests Using Multi-Temporal Hyperion Spaceborne Imaging Spectroscopy , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[14]  Jean-Yves Tourneret,et al.  Online Unmixing of Multitemporal Hyperspectral Images Accounting for Spectral Variability , 2015, IEEE Transactions on Image Processing.

[15]  Simo Särkkä,et al.  Bayesian Filtering and Smoothing , 2013, Institute of Mathematical Statistics textbooks.

[16]  K. C. Ho,et al.  Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing , 2014, IEEE Signal Processing Magazine.

[17]  Margaret E. Gardner,et al.  Mapping Chaparral in the Santa Monica Mountains Using Multiple Endmember Spectral Mixture Models , 1998 .

[18]  Ricardo Augusto Borsoi,et al.  Deep Generative Models for Library Augmentation in Multiple Endmember Spectral Mixture Analysis , 2019, ArXiv.

[19]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[20]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .

[22]  Ricardo Augusto Borsoi,et al.  Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing , 2019, IEEE Transactions on Computational Imaging.

[23]  Ricardo Augusto Borsoi,et al.  Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability , 2018, IEEE Transactions on Image Processing.

[24]  Pol Coppin,et al.  Endmember variability in Spectral Mixture Analysis: A review , 2011 .

[25]  Jocelyn Chanussot,et al.  Dynamical Spectral Unmixing of Multitemporal Hyperspectral Images , 2015, IEEE Transactions on Image Processing.

[26]  Johannes R. Sveinsson,et al.  Sparse Distributed Multitemporal Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.