Spectral-spatial analysis in hyperspectral remote sensing: from morphological profiles to classified segmentation

In this paper, we cover a decade of research in the field of spectral-spatial classification in hyperspectral remote sensing. While the very rich spectral information is usually used through pixel-wise classification in order to recognize the physical properties of the sensed material, the spatial information, with a constantly increasing resolution, provides insightful features to analyze the geometrical structures present in the picture. This is especially important for the analysis of urban areas, while this helps reducing the classification noise in other cases. The very high dimension of hyperspectral data is a very challenging issue when it comes to classification. Support Vector Machines are nowadays widely aknowledged as a first choice solution. In parallel, catching the spatial information is also very challenging. Mathematical morphology provides adequate tools: granulometries (the morphological profile) for feature extraction, advanced filters for the definition of adaptive neighborhoods, the following natural step being an actual segmentation of the data. In order to merge spectral and spatial information, different strategies can be designed: data fusion at the feature level or decision fusion combining the results of a segmentation on the one hand and the result of a pixel wise classification on the other hand.

[1]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[2]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Yang Hong,et al.  A back - propagation neural network for mineralogical mapping from AVIRIS data , 1997 .

[4]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[5]  Stephen G. Ungar,et al.  Development and operations of the EO-1 Hyperion Imaging Spectrometer , 2000, SPIE Optics + Photonics.

[6]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[8]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[9]  A. Widayati,et al.  APPLICATION OF COMBINED PIXEL-BASED AND SPATIAL-BASED APPROACHES FOR IMPROVED MIXED VEGETATION CLASSIFICATION USING IKONOS , 2002 .

[10]  N. Keshava,et al.  Distance metrics and band selection in hyperspectral processing with applications to material identification and spectral libraries , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jon Atli Benediktsson,et al.  Adaptive pixel neighborhood definition for the classification of hyperspectral images with support vector machines and composite kernel , 2008, 2008 15th IEEE International Conference on Image Processing.

[12]  Melba M. Crawford,et al.  Unsupervised multistage image classification using hierarchical clustering with a bayesian similarity measure , 2005, IEEE Transactions on Image Processing.

[13]  Mathieu Fauvel,et al.  Spectral and Spatial Methods for the Classification of Urban Remote Sensing Data , 2007 .

[14]  Rory O'Connor,et al.  The civil air patrol ARCHER hyperspectral sensor system , 2005, SPIE Defense + Commercial Sensing.

[15]  N. B. Venkateswarlu,et al.  Fast isodata clustering algorithms , 1992, Pattern Recognit..

[16]  Yuliya Tarabalka,et al.  Real-time anomaly detection in hyperspectral images using multivariate normal mixture models and GPU processing , 2009, Journal of Real-Time Image Processing.

[17]  J. Anthony Gualtieri,et al.  Support vector machines for hyperspectral remote sensing classification , 1999, Other Conferences.

[18]  Chein-I. Chang.  Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[19]  Zhihua Mao,et al.  Classification of coastal areas by airborne hyperspectral image , 2005, Other Conferences.

[20]  Jon Atli Benediktsson,et al.  Classification of hyperspectral images using automatic marker selection and Minimum Spanning Forest , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[21]  Nahum Gat,et al.  Methodology for hyperspectral image classification using novel neural network , 1997, Defense, Security, and Sensing.

[22]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[24]  Robert W. Basedow,et al.  HYDICE: an airborne system for hyperspectral imaging , 1993, Defense, Security, and Sensing.

[25]  Patrick Hostert,et al.  Classifying segmented hyperspectral data from a heterogeneous urban environment using support vector machines , 2007 .

[26]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Data using Watershed , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Jocelyn Chanussot,et al.  Decision Fusion for the Classification of Hyperspectral Data: Outcome of the 2008 GRS-S Data Fusion Contest , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jon Atli Benediktsson,et al.  Classification based marker selection for watershed transform of hyperspectral images , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[29]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[30]  S. Prasher,et al.  Classification of hyperspectral data by decision trees and artificial neural networks to identify weed stress and nitrogen status of corn , 2003 .

[31]  Mercedes Fernández-Redondo,et al.  Some Experiments with Ensembles of Neural Networks for Classification of Hyperspectral Images , 2004, ISNN.

[32]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[33]  Geoffrey H. Ball,et al.  ISODATA, A NOVEL METHOD OF DATA ANALYSIS AND PATTERN CLASSIFICATION , 1965 .

[34]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[35]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[36]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[37]  Geert M. P. van Kempen,et al.  Segmentation of multi-spectral images using the combined classifier approach , 2003, Image Vis. Comput..

[38]  José Luis Rojo-Álvarez,et al.  Kernel-Based Framework for Multitemporal and Multisource Remote Sensing Data Classification and Change Detection , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[40]  Jon Atli Benediktsson,et al.  Evaluation of Kernels for Multiclass Classification of Hyperspectral Remote Sensing Data , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[41]  R. Jenssen,et al.  1 THE HYMAP TM AIRBORNE HYPERSPECTRAL SENSOR : THE SYSTEM , CALIBRATION AND PERFORMANCE , 1998 .

[42]  Josiane Zerubia,et al.  Textural kernel for SVM classification in remote sensing: application to forest fire detection and urban area extraction , 2005, IEEE International Conference on Image Processing 2005.

[43]  Pierre Soille,et al.  Advances in mathematical morphology applied to geoscience and remote sensing , 2002, IEEE Trans. Geosci. Remote. Sens..

[44]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[45]  Aly A. Farag,et al.  A unified framework for MAP estimation in remote sensing image segmentation , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[46]  King-Sun Fu,et al.  A survey on image segmentation , 1981, Pattern Recognit..

[47]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .