Toward a Sparse Bayesian Markov Random Field Approach to Hyperspectral Unmixing and Classification

Recent work has shown that existing powerful Bayesian hyperspectral unmixing algorithms can be significantly improved by incorporating the inherent local spatial correlations between pixel class labels via the use of Markov random fields. We here propose a new Bayesian approach to joint hyperspectral unmixing and image classification such that the previous assumption of stochastic abundance vectors is relaxed to a formulation whereby a common abundance vector is assumed for pixels in each class. This allows us to avoid stochastic reparameterizations and, instead, we propose a symmetric Dirichlet distributionmodel with adjustable parameters for the common abundance vector of each class. Inference over the proposed model is achieved via a hybrid Gibbs sampler, and in particular, simulated annealing is introduced for the label estimation in order to avoid the local-trap problem. Experiments on a synthetic image and a popular, publicly available real data set indicate the proposed model is faster than and outperforms the existing approach quantitatively and qualitatively. Moreover, for appropriate choices of the Dirichlet parameter, it is shown that the proposed approach has the capability to induce sparsity in the inferred abundance vectors. It is demonstrated that this offers increased robustness in cases where the preprocessing endmember extraction algorithms overestimate the number of active endmembers present in a given scene.

[1]  Josiane Zerubia,et al.  Texture feature analysis using a gauss-Markov model in hyperspectral image classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Chein-I Chang,et al.  Semi-Supervised Linear Spectral Unmixing Using a Hierarchical Bayesian Model for Hyperspectral Imagery , 2008, IEEE Transactions on Signal Processing.

[3]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[4]  R. Carroll,et al.  Advanced Markov Chain Monte Carlo Methods: Learning from Past Samples , 2010 .

[5]  Radford M. Neal Sampling from multimodal distributions using tempered transitions , 1996, Stat. Comput..

[6]  S. E. Ahmed,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 2008, Technometrics.

[7]  John A. Richards,et al.  Segmented principal components transformation for efficient hyperspectral remote-sensing image display and classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[8]  Chong-Yung Chi,et al.  A Convex Analysis-Based Minimum-Volume Enclosing Simplex Algorithm for Hyperspectral Unmixing , 2009, IEEE Transactions on Signal Processing.

[9]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[10]  Anuj Srivastava,et al.  A Bayesian MRF framework for labeling terrain using hyperspectral imaging , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  José M. Bioucas-Dias,et al.  A variable splitting augmented Lagrangian approach to linear spectral unmixing , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[12]  Bin Luo,et al.  Empirical Automatic Estimation of the Number of Endmembers in Hyperspectral Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  Chang-Tsun Li,et al.  Multiresolution image segmentation integrating Gibbs sampler and region merging algorithm , 2003, Signal Process..

[14]  Nicolas Chopin,et al.  Fast simulation of truncated Gaussian distributions , 2011, Stat. Comput..

[15]  Jean-Yves Tourneret,et al.  Estimating the Granularity Coefficient of a Potts-Markov Random Field Within a Markov Chain Monte Carlo Algorithm , 2012, IEEE Transactions on Image Processing.

[16]  D. V. van Dyk,et al.  Partially Collapsed Gibbs Samplers , 2008 .

[17]  C. Robert Simulation of truncated normal variables , 2009, 0907.4010.

[18]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[19]  Alfred O. Hero,et al.  Hyperspectral Image Unmixing Using a Multiresolution Sticky HDP , 2012, IEEE Transactions on Signal Processing.

[20]  Lester Ingber,et al.  Simulated annealing: Practice versus theory , 1993 .

[21]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[22]  José M. Bioucas-Dias,et al.  Hyperspectral Unmixing Based on Mixtures of Dirichlet Components , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Alfred O. Hero,et al.  Joint Bayesian Endmember Extraction and Linear Unmixing for Hyperspectral Imagery , 2009, IEEE Transactions on Signal Processing.

[24]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Ryuei Nishii,et al.  Contextual unmixing of geospatial data based on Markov random fields and conditional random fields , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[26]  Ali Mohammad-Djafari,et al.  Bayesian analysis of spectral mixture data using Markov Chain Monte Carlo Methods , 2006 .

[27]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[29]  Alfred O. Hero,et al.  A Survey of Stochastic Simulation and Optimization Methods in Signal Processing , 2015, IEEE Journal of Selected Topics in Signal Processing.

[30]  Antonio J. Plaza,et al.  Minimum Volume Simplex Analysis: A Fast Algorithm for Linear Hyperspectral Unmixing , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jean-Yves Tourneret,et al.  Enhancing Hyperspectral Image Unmixing With Spatial Correlations , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[32]  G. Parisi,et al.  Simulated tempering: a new Monte Carlo scheme , 1992, hep-lat/9205018.

[33]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Ali Mohammad-Djafari,et al.  Bayesian Approach With Hidden Markov Modeling and Mean Field Approximation for Hyperspectral Data Analysis , 2008, IEEE Transactions on Image Processing.

[36]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[38]  Jean-Yves Tourneret,et al.  Unsupervised Post-Nonlinear Unmixing of Hyperspectral Images Using a Hamiltonian Monte Carlo Algorithm , 2014, IEEE Transactions on Image Processing.

[39]  Jon Atli Benediktsson,et al.  Adaptive Markov Random Fields for Joint Unmixing and Segmentation of Hyperspectral Images , 2013, IEEE Transactions on Image Processing.

[40]  Jean-Yves Tourneret,et al.  Linear unmixing of hyperspectral images using a scaled gradient method , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[41]  V. Pawlowsky-Glahn,et al.  Compositional data analysis : theory and applications , 2011 .

[42]  Jan Larsen,et al.  Unmixing of Hyperspectral Images using Bayesian Non-negative Matrix Factorization with Volume Prior , 2011, J. Signal Process. Syst..

[43]  Guozhen Zhang,et al.  Automatic Segmentation of Ground-Glass Opacities in Lung CT Images by Using Markov Random Field-Based Algorithms , 2012, Journal of Digital Imaging.

[44]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Hairong Qi,et al.  Endmember Extraction From Highly Mixed Data Using Minimum Volume Constrained Nonnegative Matrix Factorization , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Corinne Mailhes,et al.  Quality criteria benchmark for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.