Hybrid Spectral Unmixing: Using Artificial Neural Networks for Linear/Non-Linear Switching

Spectral unmixing is a key process in identifying spectral signature of materials and quantifying their spatial distribution over an image. The linear model is expected to provide acceptable results when two assumptions are satisfied: (1) The mixing process should occur at macroscopic level and (2) Photons must interact with single material before reaching the sensor. However, these assumptions do not always hold and more complex nonlinear models are required. This study proposes a new hybrid method for switching between linear and nonlinear spectral unmixing of hyperspectral data based on artificial neural networks. The neural networks was trained with parameters within a window of the pixel under consideration. These parameters are computed to represent the diversity of the neighboring pixels and are based on the Spectral Angular Distance, Covariance and a non linearity parameter. The endmembers were extracted using Vertex Component Analysis while the abundances were estimated using the method identified by the neural networks (Vertex Component Analysis, Fully Constraint Least Square Method, Polynomial Post Nonlinear Mixing Model or Generalized Bilinear Model). Results show that the hybrid method performs better than each of the individual techniques with high overall accuracy, while the abundance estimation error is significantly lower than that obtained using the individual methods. Experiments on both synthetic dataset and real hyperspectral images demonstrated that the proposed hybrid switch method is efficient for solving spectral unmixing of hyperspectral images as compared to individual algorithms.

[1]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[2]  Bo Du,et al.  A Mutation Operator Accelerated Quantum-Behaved Particle Swarm Optimization Algorithm for Hyperspectral Endmember Extraction , 2017, Remote. Sens..

[3]  Gerald S. Buller,et al.  Robust Unmixing Algorithms for Hyperspectral Imagery , 2016, 2016 Sensor Signal Processing for Defence (SSPD).

[4]  C. Charalambous,et al.  Conjugate gradient algorithm for efficient training of artifi-cial neural networks , 1990 .

[5]  Jun Huang,et al.  GBM-Based Unmixing of Hyperspectral Data Using Bound Projected Optimal Gradient Method , 2016, IEEE Geoscience and Remote Sensing Letters.

[6]  R. Mccoy,et al.  Mapping Desert Shrub Rangeland Using Spectral Unmixing and Modeling Spectral Mixtures with TM Data , 1997 .

[7]  Zhiguo Jiang,et al.  Subspace Matching Pursuit for Sparse Unmixing of Hyperspectral Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Lianru Gao,et al.  Edge-constrained Markov random field classification by integrating hyperspectral image with LiDAR data over urban areas , 2014 .

[9]  Jianbin Qiu,et al.  A New Design of $H$ -Infinity Piecewise Filtering for Discrete-Time Nonlinear Time-Varying Delay Systems via T–S Fuzzy Affine Models , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Hamid Reza Karimi,et al.  model reduction for continuous-time Markovian jump systems with incomplete statistics of mode information , 2014, Int. J. Syst. Sci..

[11]  Kaspar Althoefer,et al.  Automated Pipe Defect Detection and Categorization Using Camera/Laser-Based Profiler and Artificial Neural Network , 2007, IEEE Transactions on Automation Science and Engineering.

[12]  Jon Atli Benediktsson,et al.  Spectral-Spatial Hyperspectral Image Classification Using Subspace-Based Support Vector Machines and Adaptive Markov Random Fields , 2016, Remote. Sens..

[13]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[14]  Lei Wang,et al.  Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery , 2018, Trans. Inst. Meas. Control.

[15]  T. V. Ramachandra,et al.  A Neural Network Based Hybrid Mixture Model to Extract Information from Non-linear Mixed Pixels , 2012, Inf..

[16]  Lianru Gao,et al.  Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[17]  H. Lam,et al.  Stability analysis and control synthesis for fuzzy-observer-based controller of nonlinear systems: a fuzzy-model-based control approach , 2013 .

[18]  Jean-Yves Tourneret,et al.  Supervised Nonlinear Spectral Unmixing Using a Postnonlinear Mixing Model for Hyperspectral Imagery , 2012, IEEE Transactions on Image Processing.

[19]  W. Verstraeten,et al.  Nonlinear Hyperspectral Mixture Analysis for tree cover estimates in orchards , 2009 .

[20]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[21]  Maria Petrou,et al.  A time-efficient clustering method for pure class selection , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[22]  Jean-Yves Tourneret,et al.  Nonlinear unmixing of hyperspectral images using a generalized bilinear model , 2011 .

[23]  Richard J. Murphy,et al.  A Novel Spectral Unmixing Method Incorporating Spectral Variability Within Endmember Classes , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Peng Shi,et al.  Network-based event-triggered filtering for Markovian jump systems , 2016, Int. J. Control.

[25]  Liang Xiao,et al.  Supervised Spectral–Spatial Hyperspectral Image Classification With Weighted Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jocelyn Chanussot,et al.  Estimating the Number of Endmembers to Use in Spectral Unmixing of Hyperspectral Data with Collaborative Sparsity , 2017, LVA/ICA.

[28]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[29]  Jean-Yves Tourneret,et al.  Nonlinear Spectral Unmixing of Hyperspectral Images Using Gaussian Processes , 2012, IEEE Transactions on Signal Processing.

[30]  Jianbin Qiu,et al.  Approaches to T–S Fuzzy-Affine-Model-Based Reliable Output Feedback Control for Nonlinear Itô Stochastic Systems , 2017, IEEE Transactions on Fuzzy Systems.

[31]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[32]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2005, IEEE Trans. Geosci. Remote. Sens..

[33]  Maria Petrou,et al.  A Time-Efficient Method for Anomaly Detection in Hyperspectral Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Antonio Plaza,et al.  Hyperspectral Image Classification using a Self-Organizing Map , 2001 .

[36]  José M. Bioucas-Dias,et al.  Unmixing hyperspectral intimate mixtures , 2010, Remote Sensing.

[37]  Jean-Yves Tourneret,et al.  Hyperspectral Unmixing With Spectral Variability Using a Perturbed Linear Mixing Model , 2015, IEEE Transactions on Signal Processing.

[38]  Pol Coppin,et al.  Endmember variability in Spectral Mixture Analysis: A review , 2011 .

[39]  María Amparo Gilabert,et al.  Identification of Ecosystem Functional Types from Coarse Resolution Imagery Using a Self-Organizing Map Approach: A Case Study for Spain , 2014, Remote. Sens..

[40]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Jiayi Ma,et al.  Hyperspectral Unmixing with Robust Collaborative Sparse Regression , 2016, Remote. Sens..

[42]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[43]  Arthur R. Weeks Fundamentals of electronic image processing , 1996, SPIE/IEEE series on imaging science and engineering.

[44]  Paolo Gamba,et al.  Accurate Detection of Anthropogenic Settlements in Hyperspectral Images by Higher Order Nonlinear Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  David A. Landgrebe,et al.  Supervised classification in high-dimensional space: geometrical, statistical, and asymptotical properties of multivariate data , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[46]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[47]  Jean-Yves Tourneret,et al.  Bilinear models for nonlinear unmixing of hyperspectral images , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[48]  Bertrand Le Saux,et al.  Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images , 2017, Remote. Sens..

[49]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[50]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[51]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Jianbin Qiu,et al.  A Novel Approach to Reliable Output Feedback Control of Fuzzy-Affine Systems With Time Delays and Sensor Faults , 2017, IEEE Transactions on Fuzzy Systems.

[53]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[54]  Jie Chen,et al.  Nonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model , 2013, IEEE Transactions on Signal Processing.

[55]  Farid Melgani,et al.  A Convolutional Neural Network Approach for Assisting Avalanche Search and Rescue Operations with UAV Imagery , 2017, Remote. Sens..

[56]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[57]  G. Foody,et al.  Sub-pixel land cover composition estimation using a linear mixture model and fuzzy membership functions , 1994 .

[58]  Chein-I Chang,et al.  Adaptive Linear Spectral Mixture Analysis , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Naif Alajlan,et al.  Deep Learning Approach for Car Detection in UAV Imagery , 2017, Remote. Sens..

[60]  Brian S. Penn,et al.  Using self-organizing maps to visualize high-dimensional data , 2005, Comput. Geosci..

[61]  Gaofeng Meng,et al.  Spectral Unmixing via Data-Guided Sparsity , 2014, IEEE Transactions on Image Processing.

[62]  Stephen McLaughlin,et al.  Bayesian Nonlinear Hyperspectral Unmixing With Spatial Residual Component Analysis , 2014, IEEE Transactions on Computational Imaging.

[63]  José M. Bioucas-Dias,et al.  Nonlinear mixture model for hyperspectral unmixing , 2009, Remote Sensing.

[64]  M. K. Soni,et al.  Artificial Neural Network-Based Peak Load Forecasting Using Conjugate Gradient Methods , 2002, IEEE Power Engineering Review.

[65]  P. Keshavarz,et al.  Modeling surface tension of pure refrigerants using feed-forward back-propagation neural networks , 2017 .

[66]  B. Hapke Bidirectional reflectance spectroscopy: 1. Theory , 1981 .

[67]  Xiangyun Hu,et al.  Deep-Learning-Based Classification for DTM Extraction from ALS Point Cloud , 2016, Remote. Sens..

[68]  Stefan Raith,et al.  Artificial Neural Networks as a powerful numerical tool to classify specific features of a tooth based on 3D scan data , 2017, Comput. Biol. Medicine.

[69]  Hao Wu,et al.  Convolutional Recurrent Neural Networks forHyperspectral Data Classification , 2017, Remote. Sens..

[70]  Lichao Mou,et al.  Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection , 2016, Remote. Sens..

[71]  P. Atkinson,et al.  Mapping sub-pixel proportional land cover with AVHRR imagery , 1997 .

[72]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.