Multi-Spectro-Temporal Analysis of Hyperspectral Imagery Based on 3-D Spectral Modeling and Multilinear Algebra

Multitemporal hyperspectral images are gaining an ever-increasing importance revealed by the ambition of the remote sensing community to develop new generation of sensors. Therefore, multitemporal images classification and change detection issues are greatly relevant in several research topics. In this paper, we propose a novel approach for modeling the temporal variation of the reflectance response as a function of time period and wavelength; summarizing the spectral signature of hyperspectral pixels as a 3-D mesh. This approach is adopted for hyperspectral time series analysis leading to the main following contribution: an advanced form of the temporal spectral signature defining the reflectance at each pixel as a congregation of the spatial/spectral/temporal dimensions. Afterward, by formulating the temporal data set in an adequate multidimensional feature space of contextual data, an innovative processing scheme exploiting the theoretical backgrounds of 3-D surface reconstruction and matching is adopted for data interpretation. Finally, an improved method for multitemporal endmember extraction and spectral unmixing based on multilinear algebra methods is introduced. A case study, in a region located in southern Tunisia, is conducted on a multitemporal subset of Hyperion images. Up to 89.86% of sampling sites have been correctly predicted by the proposed approach, outperforming conventional classifiers. The good performances obtained, on simulated multitemporal images and over various real experimental scenarios, illustrate the effectiveness and the generalization capacities of the proposed approach.

[1]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[2]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[3]  D.C. Heinz,et al.  Temporal-Spectral Detection in Long-Wave IR Hyperspectral Imagery , 2010, IEEE Sensors Journal.

[4]  Haibin Ling,et al.  An Efficient Earth Mover's Distance Algorithm for Robust Histogram Comparison , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Russell C. Hardie,et al.  Hyperspectral Change Detection in the Presenceof Diurnal and Seasonal Variations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Hui Li,et al.  Pixel-Unmixing Moderate-Resolution Remote Sensing Imagery Using Pairwise Coupling Support Vector Machines: A Case Study , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[7]  L.M. Bruce,et al.  Feature extraction via spectro-temporal analysis of hyperspectral data for vegetative target detection , 2005, International Workshop on the Analysis of Multi-Temporal Remote Sensing Images, 2005..

[8]  Curtis E. Woodcock,et al.  Monitoring large areas for forest change using Landsat: Generalization across space, time and Landsat sensors , 2001 .

[9]  Dietmar Saupe,et al.  Tools for 3D-object retrieval: Karhunen-Loeve transform and spherical harmonics , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[10]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[11]  H. Kiers An alternating least squares algorithms for PARAFAC2 and three-way DEDICOM , 1993 .

[12]  A. Kuusk,et al.  A dataset for the validation of reflectance models , 2009 .

[13]  Anthony Vodacek,et al.  Generation of synthetic infrared remote-sensing scenes of wildland fire , 2009 .

[14]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Classification , 2005, Australian Conference on Artificial Intelligence.

[15]  Imed Riadh Farah,et al.  Multi-temporal Hyperspectral Images Unmixing and Classification Based on 3D Signature Model and Matching , 2010 .

[16]  José Luis Rojo-Álvarez,et al.  Kernel-Based Framework for Multitemporal and Multisource Remote Sensing Data Classification and Change Detection , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Benoit Rivard,et al.  Intra- and inter-class spectral variability of tropical tree species at La Selva, Costa Rica: Implications for species identification using HYDICE imagery , 2006 .

[18]  Chein-I Chang,et al.  Applications of Kalman Filtering to Single Hyperspectral Signature Analysis , 2010, IEEE Sensors Journal.

[19]  Pol Coppin,et al.  Endmember variability in Spectral Mixture Analysis: A review , 2011 .

[20]  Nikos Paragios,et al.  Large-Scale Building Reconstruction Through Information Fusion and 3-D Priors , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Ryutarou Ohbuchi,et al.  Shape-similarity search of 3D models by using enhanced shape functions , 2003, Proceedings of Theory and Practice of Computer Graphics, 2003..

[22]  Mohamed Ben Ahmed,et al.  Multiapproach System Based on Fusion of Multispectral Images for Land-Cover Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Gautam D. Badhwar,et al.  Based Crop Recognition , 1987 .

[24]  Farid Melgani Classification Of Multitemporal Remote-Sensing Images By A Fuzzy Fusion Of Spectral And Spatio-Temporal Contextual Information , 2004, Int. J. Pattern Recognit. Artif. Intell..

[25]  Sebastiano B. Serpico,et al.  A Markov random field approach to spatio-temporal contextual image classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[26]  Herbert Edelsbrunner,et al.  Geometry and Topology for Mesh Generation (Cambridge Monographs on Applied and Computational Mathematics) , 2006 .

[27]  S. J. Sutley,et al.  USGS Digital Spectral Library splib06a , 2007 .

[28]  A. Kaarna,et al.  Compression and classification methods for hyperspectral images , 2006, Pattern Recognition and Image Analysis.

[29]  Indriyati Atmosukarto,et al.  Feature Combination and Relevance Feedback for 3D Model Retrieval , 2005, 11th International Multimedia Modelling Conference.

[30]  Liming Chen,et al.  A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[31]  Daniel Schläpfer MODO : AN INTERFACE TO MODTRAN FOR THE SIMULATION OF IMAGING SPECTROMETRY AT-SENSOR SIGNALS , 1998 .

[32]  Saurabh Prasad,et al.  A Robust Multi-Classifier Decision Fusion Framework for Hyperspectral, Multi-Temporal Classification , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[33]  Erzsébet Merényi,et al.  Automated Labeling of Materials in Hyperspectral Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Megan M. Lewis,et al.  Discrimination of arid vegetation with airborne multispectral scanner hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[35]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[36]  P. George,et al.  Delaunay's mesh of a convex polyhedron in dimension d. application to arbitrary polyhedra , 1992 .

[37]  Paul D. Gader,et al.  Application of Multiple-Instance Learning for Hyperspectral Image Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[38]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[39]  Sang-Wook Kim,et al.  Efficient processing of subsequence matching with the euclidean metric in time-series databases , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[40]  Weng-Kin Lai,et al.  Investigations into Particle Swarm Optimization for Multi-class Shape Recognition , 2008, ICONIP.

[41]  Chein-I Chang,et al.  An information-theoretic approach to spectral variability, similarity, and discrimination for hyperspectral image analysis , 2000, IEEE Trans. Inf. Theory.

[42]  Ichiro Hagiwara,et al.  Two Techniques to Improve Mesh Quality and Preserve Surface Characteristics , 2004, IMR.

[43]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[44]  C. Woodcock,et al.  The spectral/temporal manifestation of forest succession in optical imagery: The potential of multitemporal imagery , 2002 .

[45]  Pasi Koikkalainen,et al.  Progress with the Tree-Structured Self-Organizing Map , 1994, ECAI.

[46]  Robert H. Fraser,et al.  Signature extension through space for northern landcover classification: A comparison of radiometric correction methods , 2005 .

[47]  Andrew Chan,et al.  An SVDD-Based Algorithm for Target Detection in Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[48]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.