Automatic Object-Oriented, Spectral-Spatial Feature Extraction Driven by Tobler's First Law of Geography for Very High Resolution Aerial Imagery Classification

Aerial image classification has become popular and has attracted extensive research efforts in recent decades. The main challenge lies in its very high spatial resolution but relatively insufficient spectral information. To this end, spatial-spectral feature extraction is a popular strategy for classification. However, parameter determination for that feature extraction is usually time-consuming and depends excessively on experience. In this paper, an automatic spatial feature extraction approach based on image raster and segmental vector data cross-analysis is proposed for the classification of very high spatial resolution (VHSR) aerial imagery. First, multi-resolution segmentation is used to generate strongly homogeneous image objects and extract corresponding vectors. Then, to automatically explore the region of a ground target, two rules, which are derived from Tobler’s First Law of Geography (TFL) and a topological relationship of vector data, are integrated to constrain the extension of a region around a central object. Third, the shape and size of the extended region are described. A final classification map is achieved through a supervised classifier using shape, size, and spectral features. Experiments on three real aerial images of VHSR (0.1 to 0.32 m) are done to evaluate effectiveness and robustness of the proposed approach. Comparisons to state-of-the-art methods demonstrate the superiority of the proposed method in VHSR image classification.

[1]  Shihong Du,et al.  Semantic classification of urban buildings combining VHR image and GIS data: An improved random forest approach , 2015 .

[2]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[3]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[5]  H. Miller Tobler's First Law and Spatial Analysis , 2004 .

[6]  D. Griffith Spatial Autocorrelation and Spatial Filtering: Gaining Understanding Through Theory and Scientific Visualization , 2010 .

[7]  Hye-Jin Kim,et al.  A shape–size index extraction for classification of high resolution multispectral satellite images , 2012 .

[8]  Yi Yang,et al.  Discovering Discriminative Graphlets for Aerial Image Categories Recognition , 2013, IEEE Transactions on Image Processing.

[9]  Alfred Stein,et al.  Context-sensitive extraction of tree crown objects in urban areas using VHR satellite images , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[10]  Wenzhong Shi,et al.  Classification of Very High Spatial Resolution Imagery Based on a New Pixel Shape Feature Set , 2014, IEEE Geoscience and Remote Sensing Letters.

[11]  Jon Atli Benediktsson,et al.  Automatic Framework for Spectral–Spatial Classification Based on Supervised Feature Extraction and Morphological Attribute Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Tülay Adali,et al.  Classification of hyperspectral data with ensemble of subspace ICA and edge-preserving filtering , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Catherine A. Calder,et al.  Beyond Moran's I: Testing for Spatial Dependence Based on the Spatial Autoregressive Model , 2007 .

[14]  Yingmei Wei,et al.  Order based feature description for high-resolution aerial image classification , 2014 .

[15]  Anil M. Cheriyadat,et al.  Unsupervised Feature Learning for Aerial Scene Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[17]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[18]  K. Moffett,et al.  Remote Sens , 2015 .

[19]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[20]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Liangpei Zhang,et al.  Detail-Preserving Smoothing Classifier Based on Conditional Random Fields for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  François Rousset,et al.  Testing environmental and genetic effects in the presence of spatial autocorrelation , 2014 .

[23]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[24]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jon Atli Benediktsson,et al.  Spectral and Spatial Classification of Hyperspectral Images Based on ICA and Reduced Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[27]  Anshuman Bhardwaj,et al.  UAVs as remote sensing platform in glaciology: Present applications and future prospects , 2016 .

[28]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Yu Wang,et al.  A study of a Gaussian mixture model for urban land-cover mapping based on VHR remote sensing imagery , 2016 .

[30]  Jon Atli Benediktsson,et al.  Morphological Profiles Based on Differently Shaped Structuring Elements for Classification of Images With Very High Spatial Resolution , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Fan Xia,et al.  Assessing object-based classification: advantages and limitations , 2009 .

[32]  Jon Atli Benediktsson,et al.  A Survey on Spectral–Spatial Classification Techniques Based on Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Liangpei Zhang,et al.  High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random Fields , 2016, IEEE Transactions on Image Processing.

[34]  Zhiyong Lv,et al.  Object-Based Spatial Feature for Classification of Very High Resolution Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[35]  L. Durieux,et al.  Advances in Geographic Object-Based Image Analysis with ontologies: A review of main contributions and limitations from a remote sensing perspective , 2013 .

[36]  Alfred Stein,et al.  Region-based urban road extraction from VHR satellite images using Binary Partition Tree , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[37]  Isao Endo,et al.  Image Segmentation Parameter Optimization Considering Within- and Between-Segment Heterogeneity at Multiple Scale Levels: Test Case for Mapping Residential Areas Using Landsat Imagery , 2015, ISPRS Int. J. Geo Inf..

[38]  Gabriele Moser,et al.  Combining Support Vector Machines and Markov Random Fields in an Integrated Framework for Contextual Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jon Atli Benediktsson,et al.  Land-Cover Mapping by Markov Modeling of Spatial–Contextual Information in Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.