Multi-scale hierarchical sampling change detection using Random Forest for high-resolution satellite imagery

ABSTRACT High-resolution imagery provides rich information useful for land-use and land-cover change detection; however, methods to exploit these data lag behind data collection technologies. In this article, we propose a novel object-oriented multi-scale hierarchical sampling (MSHS) change detection method for high-resolution satellite imagery. In our method, MSHS is carried out to automatically obtain multi-scale training samples and different sample combinations. The training sample spectra, texture, and shape features are fused to build feature space after MSHS. Sample combinations and corresponding feature spaces are input into Random Forest (RF) to train multiple change classifiers. An optimal RF change detection classifier is selected when the out-of-bag error parameter in RF is at the minimum. In order to validate the proposed method, we applied it to high-resolution satellite image data and compared the detection results from our method and the single-scale sampling change detection method. These experimental results show that false alarm rates and missed detection of changed objects using our method were lower than the single-scale sampling change detection method. To demonstrate the scalability of the algorithm, different change detection methods were applied to three study sites. Experimental results show that our method delivered high overall accuracy and F1-scores. Compared to traditional methods, our method makes full use of the multi-scale characteristics of ground objects. Our approach does not extend multi-scale feature vectors directly, but instead automatically increases the amount of the training samples at multiple scales, without increasing the volume of manual processing, thus improving the ability of the algorithm to generalize features from the RF model, making it more robust.

[1]  Ignazio Gallo,et al.  A neural adaptive model for feature extraction and recognition in high resolution remote sensing imagery , 2003 .

[2]  Albert Rango,et al.  Multispectral Remote Sensing from Unmanned Aircraft: Image Processing Workflows and Applications for Rangeland Environments , 2011, Remote. Sens..

[3]  Y. Ouma,et al.  Analysis of co‐occurrence and discrete wavelet transform textures for differentiation of forest and non‐forest vegetation in very‐high‐resolution optical‐sensor imagery , 2008 .

[4]  Ophir Frieder,et al.  On understanding and classifying web queries , 2006 .

[5]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Antanas Verikas,et al.  Mining data with random forests: A survey and results of new tests , 2011, Pattern Recognit..

[7]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[8]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Ping Lu,et al.  Object-Oriented Change Detection for Landslide Rapid Mapping , 2011, IEEE Geoscience and Remote Sensing Letters.

[10]  Lei Ma,et al.  Training set size, scale, and features in Geographic Object-Based Image Analysis of very high resolution unmanned aerial vehicle imagery , 2015 .

[11]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[12]  R. Pu,et al.  A comparative analysis of high spatial resolution IKONOS and WorldView-2 imagery for mapping urban tree species , 2012 .

[13]  T. Blaschke,et al.  Object-based contextual image classification built on image segmentation , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[14]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  Johannes R. Sveinsson,et al.  Random Forests for land cover classification , 2006, Pattern Recognit. Lett..

[17]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in VHR Multispectral Images , 2010, IEEE Transactions on Image Processing.

[18]  Rick L. Lawrence,et al.  Mapping invasive plants using hyperspectral imagery and Breiman Cutler classifications (RandomForest) , 2006 .

[19]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[20]  Koreen Millard,et al.  On the Importance of Training Data Sample Selection in Random Forest Image Classification: A Case Study in Peatland Ecosystem Mapping , 2015, Remote. Sens..

[21]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in Very High Resolution Multispectral Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Turgay Çelik,et al.  Multiscale Change Detection in Multitemporal Satellite Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[23]  David M. Johnson,et al.  Impacts of imagery temporal frequency on land-cover change detection monitoring , 2004 .

[24]  Thomas Blaschke,et al.  Object-Based Change Detection in Urban Areas: The Effects of Segmentation Strategy, Scale, and Feature Space on Unsupervised Methods , 2016, Remote. Sens..

[25]  Ivan Lizarazo,et al.  Quantitative land cover change analysis using fuzzy segmentation , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[26]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[27]  Thomas Blaschke,et al.  Object-oriented image analysis and scale-space: Theory and methods for modeling and evaluating multi-scale landscape structure , 2001 .

[28]  P. Gong,et al.  Object-based analysis and change detection of major wetland cover types and their classification uncertainty during the low water period at Poyang Lake, China , 2011 .

[29]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[30]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[31]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[32]  Naif Alajlan,et al.  Interactive Segmentation for Change Detection in Multispectral Remote-Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[33]  C. Burnett,et al.  A multi-scale segmentation/object relationship modelling methodology for landscape analysis , 2003 .

[34]  James D. Wickham,et al.  Pixels, blocks of pixels, and polygons: Choosing a spatial unit for thematic accuracy assessment , 2011 .

[35]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[36]  P. Atkinson,et al.  Incorporating Spatial Variability Measures in Land-cover Classification using Random Forest , 2011 .

[37]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[38]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Francesca Bovolo,et al.  A Multilevel Parcel-Based Approach to Change Detection in Very High Resolution Multitemporal Images , 2005, IEEE Geoscience and Remote Sensing Letters.

[40]  Delu Pan,et al.  Detecting changes in high-resolution satellite coastal imagery using an image object detection approach , 2013 .

[41]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.