Enhanced decision tree ensembles for land-cover mapping from fully polarimetric SAR data

ABSTRACT Fully polarimetric synthetic aperture radar (PolSAR) Earth Observations showed great potential for mapping and monitoring agro-environmental systems. Numerous polarimetric features can be extracted from these complex observations which may lead to improve accuracy of land-cover classification and object characterization. This article employed two well-known decision tree ensembles, i.e. bagged tree (BT) and random forest (RF), for land-cover mapping from PolSAR imagery. Moreover, two fast modified decision tree ensembles were proposed in this article, namely balanced filter-based forest (BFF) and cost-sensitive filter-based forest (CFF). These algorithms, designed based on the idea of RF, use a fast filter feature selection algorithms and two extended majority voting. They are also able to embed some solutions of imbalanced data problem into their structures. Three different PolSAR datasets, with imbalanced data, were used for evaluating efficiency of the proposed algorithms. The results indicated that all the tree ensembles have higher efficiency and reliability than the individual DT. Moreover, both proposed tree ensembles obtained higher mean overall accuracy (0.5–14% higher), producer’s accuracy (0.5–10% higher), and user’s accuracy (0.5–9% higher) than the classical tree ensembles, i.e. BT and RF. They were also much faster (e.g. 2–10 times) and more stable than their competitors for classification of these three datasets. In addition, unlike BT and RF, which obtained higher accuracy in large ensembles (i.e. the high number of DT), BFF and CFF can also be more efficient and reliable in smaller ensembles. Furthermore, the extended majority voting techniques could outperform the classical majority voting for decision fusion.

[1]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[2]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[3]  Heather McNairn,et al.  Early season monitoring of corn and soybeans with TerraSAR-X and RADARSAT-2 , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[4]  Rui Zhang,et al.  A novel feature selection method considering feature interaction , 2015, Pattern Recognit..

[5]  Heather McNairn,et al.  Towards operational radar-only crop type classification: comparison of a traditional decision tree with a random forest classifier , 2012 .

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  V. Alberga,et al.  A study of land cover classification using polarimetric SAR parameters , 2007 .

[8]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[9]  Heather McNairn,et al.  A particle swarm optimized kernel-based clustering method for crop mapping from multi-temporal polarimetric L-band SAR observations , 2017, Int. J. Appl. Earth Obs. Geoinformation.

[10]  P. Zingaretti,et al.  Performance evaluation of automated approaches to building detection in multi-source aerial data , 2010 .

[11]  Jean-Claude Souyris,et al.  Support Vector Machine for Multifrequency SAR Polarimetric Data Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Stephen L. Durden,et al.  A three-component scattering model for polarimetric SAR data , 1998, IEEE Trans. Geosci. Remote. Sens..

[13]  Simon Yueh,et al.  Application of neural networks to radar image classification , 1994, IEEE Trans. Geosci. Remote. Sens..

[14]  Yasser Maghsoudi,et al.  A New Method for Land Cover Characterization and Classification of Polarimetric SAR Data Using Polarimetric Signatures , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Huan Liu,et al.  Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution , 2003, ICML.

[16]  Eric Pottier,et al.  A review of target decomposition theorems in radar polarimetry , 1996, IEEE Trans. Geosci. Remote. Sens..

[17]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[18]  Jong-Sen Lee,et al.  Classification comparisons between dual-pol, compact polarimetric and quad-pol SAR imagery , 2009 .

[19]  S. Fukuda,et al.  Support vector machine classification of land cover: application to polarimetric SAR data , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[20]  Huanxin Zou,et al.  Feature selection and weighted SVM classifier-based ship detection in PolSAR imagery , 2013 .

[21]  Peijun Du,et al.  Polarimetric SAR image classification by Boosted Multiple-Kernel Extreme Learning Machines with polarimetric and spatial features , 2014 .

[22]  Okko Johannes Räsänen,et al.  Random subset feature selection in automatic recognition of developmental disorders, affective states, and level of conflict from speech , 2013, INTERSPEECH.

[23]  T. Eltoft,et al.  CLASSIFICATION COMPARISONS BETWEEN COMPACT POLARIMETRIC AND QUAD-POL SAR IMAGERY , 2015 .

[24]  E. Krogager New decomposition of the radar target scattering matrix , 1990 .

[25]  Yasser Maghsoudi,et al.  Improving the Accuracy of Urban Land Cover Classification Using Radarsat-2 PolSAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  A. Abkar,et al.  SUPERVISED CLASSIFICATION OF POLARIMETRIC SAR IMAGERY USING TEMPORAL AND CONTEXTUAL INFORMATION , 2013 .

[27]  Seiho Uratsuka,et al.  A study on extraction of urban areas from polarimetric Synthetic Aperture Radar image , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[28]  David Small,et al.  Improving PolSAR Land Cover Classification With Radiometric Correction of the Coherency Matrix , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Björn Waske,et al.  Classifier ensembles for land cover mapping using multitemporal SAR imagery , 2009 .

[30]  Lorenzo Bruzzone,et al.  An advanced system for the automatic classification of multitemporal SAR images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Okko Johannes Räsänen,et al.  Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits , 2015, Comput. Speech Lang..

[32]  A. Mansourian,et al.  Polarimetric SAR feature selection using a genetic algorithm , 2011 .

[33]  Liangpei Zhang,et al.  Polarimetric-Spatial Classification of SAR Images Based on the Fusion of Multiple Classifiers , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Hiroyoshi Yamada,et al.  Four-component scattering model for polarimetric SAR image decomposition , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Klaus Nordhausen,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman , 2009 .

[36]  Ron Kwok,et al.  Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution , 1994 .

[37]  Rushi Longadge,et al.  Class Imbalance Problem in Data Mining Review , 2013, ArXiv.

[38]  Lei Yu,et al.  Fast Correlation Based Filter (FCBF) with a different search strategy , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[39]  Matthieu Molinier,et al.  Polarimetric SAR Data in Land Cover Mapping in Boreal Zone , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Xia Li,et al.  A novel algorithm for land use and land cover classification using RADARSAT-2 polarimetric SAR data , 2012 .

[41]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[42]  Jong-Sen Lee,et al.  Polarimetric SAR speckle filtering and its implication for classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[43]  Yoshio Yamaguchi,et al.  Land Cover Classification of Palsar Images by Knowledge Based Decision Tree Classifier and Supervised Classifiers Based on SAR Observables , 2011 .

[44]  Linlin Xu,et al.  A comparative study of different classification techniques for marine oil spill identification using RADARSAT-1 imagery , 2014 .

[45]  M. Motagh,et al.  Classification of polarimetric SAR images using Support Vector Machines , 2011 .

[46]  Boularbah Souissi,et al.  Optimal SVM Classification for Compact Polarimetric Data Using Stokes Parameters , 2014, J. Math. Model. Algorithms Oper. Res..

[47]  Y. Ban,et al.  INVESTIGATING THE PERFORMANCE OF SAR POLARIMETRIC FEATURES IN LANDCOVER CLASSIFICATION , 2008 .

[48]  Sukhendu Das,et al.  A Survey of Decision Fusion and Feature Fusion Strategies for Pattern Classification , 2010, IETE Technical Review.

[49]  Hamid Ebadi,et al.  Improving the Accuracy of Land Cover Classification Using Fusion of Polarimetric SAR and Hyperspectral Images , 2016, Journal of the Indian Society of Remote Sensing.

[50]  Peijun Du,et al.  Random Forest and Rotation Forest for fully polarized SAR image classification using polarimetric and spatial features , 2015 .

[51]  Gonzalo Pajares,et al.  Improving the Wishart Synthetic Aperture Radar image classifications through Deterministic Simulated Annealing , 2011 .

[52]  Giuseppe Satalino,et al.  Comparison of polarimetric SAR observables in terms of classification performance , 2008 .

[53]  Björn Waske,et al.  Classifying Multilevel Imagery From SAR and Optical Sensors by Decision Fusion , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[54]  M. Habibi,et al.  Classification of Polarimetric SAR Data Based on Object-Based Multiple Classifiers for Urban Land-Cover , 2016, Journal of the Indian Society of Remote Sensing.

[55]  Heather McNairn,et al.  In-season crop inventory using multi-angle and multi-pass RADARTSAT-2 SAR data over the Canadian prairies , 2011, Optical Engineering + Applications.

[56]  Yasser Maghsoudi,et al.  Polarimetric classification of Boreal forest using nonparametric feature selection and multiple classifiers , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[57]  Fuk K. Li,et al.  Symmetry properties in polarimetric remote sensing , 1992 .

[58]  Laurent Ferro-Famil,et al.  Unsupervised classification of multifrequency and fully polarimetric SAR images based on the H/A/Alpha-Wishart classifier , 2001, IEEE Trans. Geosci. Remote. Sens..

[59]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[60]  Xin Niu,et al.  A Novel Contextual Classification Algorithm for Multitemporal Polarimetric SAR Data , 2014, IEEE Geoscience and Remote Sensing Letters.

[61]  Lijun Chen,et al.  Supervised feature selection for polarimetric SAR classification , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[62]  Zhang Juan,et al.  Integrating color features in polarimetric SAR image classification , 2017 .

[63]  Iman Khosravi,et al.  Multiple Classifier Systems for Hyperspectral Remote Sensing Data Classification , 2013, Journal of the Indian Society of Remote Sensing.

[64]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[65]  Xia Li,et al.  A three-component method for timely detection of land cover changes using polarimetric SAR images , 2015 .