Hyperspectral Image Classification With Canonical Correlation Forests

Multiple classifier systems or ensemble learning is an effective tool for providing accurate classification results of hyperspectral remote sensing images. Two well-known ensemble learning classifiers for hyperspectral data are random forest (RF) and rotation forest (RoF). In this paper, we proposed to use a novel decision tree (DT) ensemble method, namely, canonical correlation forest (CCF). More specifically, several individual canonical correlation trees (CCTs) that are binary DTs, which use canonical correlation components for the hyperplane splitting, are used to construct the CCF. Additionally, we adopt the projection bootstrap technique in CCF, in which the full spectral bands are retained for split selection in the projected space. The techniques aforementioned allow the CCF to improve the accuracy of member classifiers and diversity within the ensemble. Furthermore, the CCF is extended to the spectral-spatial frameworks that incorporate Markov random fields, extended multiattribute profiles (EMAPs), and the ensemble of independent component analysis and rolling guidance filter (E-ICA-RGF). Experimental results on six hyperspectral data sets are used to indicate the comparative effectiveness of the proposed method, in terms of accuracy and computational complexity, compared with RF and RoF, and it turns out that CCF is a promising approach for hyperspectral image classification not only with spectral information but also in the spectral-spatial frameworks.

[1]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[2]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[3]  Jon Atli Benediktsson,et al.  Support Tensor Machines for Classification of Hyperspectral Remote Sensing Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Peijun Du,et al.  Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[6]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Frank D. Wood,et al.  Canonical Correlation Forests , 2015, ArXiv.

[8]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[9]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[10]  S. Dunagan,et al.  The MARTE VNIR imaging spectrometer experiment: design and analysis. , 2008, Astrobiology.

[11]  Peijun Du,et al.  Random Forest and Rotation Forest for fully polarized SAR image classification using polarimetric and spatial features , 2015 .

[12]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[15]  Adrian J. Brown Spectral curve fitting for automatic hyperspectral data analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Robert P. W. Duin,et al.  Is independence good for combining classifiers? , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[17]  Ludmila I. Kuncheva Diversity in multiple classifier systems , 2005, Inf. Fusion.

[18]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Adrian J. Brown,et al.  The MARTE VNIR imaging spectrometer experiment: design and analysis. , 2008, Astrobiology.

[21]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[22]  Chein-I Chang,et al.  Hyperspectral Data Exploitation , 2007 .

[23]  Taskin Kavzoglu,et al.  Object-based classification with rotation forest ensemble learning algorithm using very-high-resolution WorldView-2 image , 2015 .

[24]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[25]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[26]  Jonathan Cheung-Wai Chan,et al.  Evaluation of random forest and adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery , 2008 .

[27]  Peijun Du,et al.  Rotation-Based Support Vector Machine Ensemble in Classification of Hyperspectral Data With Limited Training Samples , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jon Atli Benediktsson,et al.  Class-Separation-Based Rotation Forest for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[29]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[30]  J. R. Sveinsson,et al.  Mapping of hyperspectral AVIRIS data using machine-learning algorithms , 2009 .

[31]  Jon Atli Benediktsson,et al.  Multiple Classifier Systems in Remote Sensing: From Basics to Recent Developments , 2007, MCS.

[32]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Jocelyn Chanussot,et al.  Rotation-Based Ensemble Classifiers for High-Dimensional Data , 2014, Fusion in Computer Vision.

[35]  Tülay Adali,et al.  Spectral–Spatial Classification of Hyperspectral Images Using ICA and Edge-Preserving Filter via an Ensemble Strategy , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[37]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[38]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[40]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[41]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[42]  Gene H. Golub,et al.  Numerical methods for computing angles between linear subspaces , 1971, Milestones in Matrix Computation.

[43]  Lorenzo Bruzzone,et al.  Extended profiles with morphological attribute filters for the analysis of hyperspectral data , 2010 .

[44]  Peijun Du,et al.  Improving Random Forest With Ensemble of Features and Semisupervised Feature Extraction , 2015, IEEE Geoscience and Remote Sensing Letters.

[45]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[47]  Simon J. Hook,et al.  HYDROTHERMAL FORMATION OF CLAY-CARBONATE ALTERATION ASSEMBLAGES IN THE , 2010, 1402.1150.

[48]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[49]  Peijun Du,et al.  Hyperspectral Remote Sensing Image Classification Based on Rotation Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[50]  M. Pal,et al.  Random forests for land cover classification , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[51]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[52]  Chein-I. Chang Hyperspectral Data Exploitation: Theory and Applications , 2007 .

[53]  Tülay Adali,et al.  Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Signal Processing.

[54]  Tülay Adali,et al.  Complex Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.