Classification of large-sized hyperspectral imagery using fast machine learning algorithms

Abstract. We present a framework of fast machine learning algorithms in the context of large-sized hyperspectral images classification from the theoretical to a practical viewpoint. In particular, we assess the performance of random forest (RF), rotation forest (RoF), and extreme learning machine (ELM) and the ensembles of RF and ELM. These classifiers are applied to two large-sized hyperspectral images and compared to the support vector machines. To give the quantitative analysis, we pay attention to comparing these methods when working with high input dimensions and a limited/sufficient training set. Moreover, other important issues such as the computational cost and robustness against the noise are also discussed.

[1]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[2]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[3]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Mahesh Pal.  Extreme‐learning‐machine‐based land cover classification , 2008, ArXiv.

[5]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[6]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[9]  Michael Rast,et al.  Preface: The Environmental Mapping and Analysis Program (EnMAP) Mission: Preparing for Its Scientific Exploitation , 2016, Remote. Sens..

[10]  Peijun Du,et al.  Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  Patrick Hostert,et al.  The EnMAP Spaceborne Imaging Spectroscopy Mission for Earth Observation , 2015, Remote. Sens..

[15]  Gregory Asner,et al.  Tree Species Abundance Predictions in a Tropical Agricultural Landscape with a Supervised Classification Model and Imbalanced Data , 2016, Remote. Sens..

[16]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[17]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[18]  M. Bauer,et al.  Airborne hyperspectral remote sensing to assess spatial distribution of water quality characteristics in large rivers: the Mississippi River and its tributaries in Minnesota. , 2013 .

[19]  D. Roberts,et al.  Special issue on the Hyperspectral Infrared Imager (HyspIRI): Emerging science in terrestrial and aquatic ecology, radiation balance and hazards , 2015 .

[20]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Akira Iwasaki,et al.  Flight model performances of HISUI hyperspectral sensor onboard ISS (International Space Station) , 2016, Remote Sensing.

[23]  Zhaohui Xue,et al.  Kernel Supervised Ensemble Classifier for the Classification of Hyperspectral Data Using Few Labeled Samples , 2016, Remote. Sens..

[24]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[25]  Chein-I. Chang.  Hyperspectral Data Exploitation: Theory and Applications , 2007 .

[26]  Jocelyn Chanussot,et al.  Rotation-Based Ensemble Classifiers for High-Dimensional Data , 2014, Fusion in Computer Vision.

[27]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[28]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[30]  Naoto Yokoya,et al.  Hyperspectral Image Classification With Canonical Correlation Forests , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[32]  Peijun Du,et al.  Hyperspectral Remote Sensing Image Classification Based on Rotation Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[33]  M. Pal,et al.  Random forests for land cover classification , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[34]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[35]  Peter Reinartz,et al.  The EnMAP Contest: Developing and Comparing Classification Approaches for the Environmental Mapping and Analysis Programme - Dataset and First results , 2015 .

[36]  Dimitris G. Stavrakoudis,et al.  Decision Fusion Based on Hyperspectral and Multispectral Satellite Imagery for Accurate Forest Species Mapping , 2014, Remote. Sens..

[37]  Chein-I. Chang.  Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .