Interactive Multiscale Classification of High-Resolution Remote Sensing Images

The use of remote sensing images (RSIs) as a source of information in agribusiness applications is very common. In those applications, it is fundamental to identify and understand trends and patterns in space occupation. However, the identification and recognition of crop regions in remote sensing images are not trivial tasks yet. In high-resolution image analysis and recognition, many of the problems are related to the representation scale of the data, and to both the size and the representativeness of the training set. In this paper, we propose a method for interactive classification of remote sensing images considering multiscale segmentation. Our aim is to improve the selection of training samples using the features from the most appropriate scales of representation. We use a boosting-based active learning strategy to select regions at various scales for user's relevance feedback. The idea is to select the regions that are closer to the border that separates both target classes: relevant and non-relevant regions. Experimental results showed that the combination of scales produces better results than isolated scales in a relevance feedback process. Furthermore, the interactive method achieved good results with few user interactions. The proposed method needs only a small portion of the training set to build classifiers that are as strong as the ones generated by a supervised method that uses the whole training set.

[1]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[2]  João Paulo Papa,et al.  Supervised pattern classification based on optimum‐path forest , 2009, Int. J. Imaging Syst. Technol..

[3]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[4]  Jefersson Alex dos Santos,et al.  Interactive Classification of Remote Sensing Images by Using Optimum-Path Forest and Genetic Programming , 2011, CAIP.

[5]  W. Mackaness,et al.  Lecture Notes in Geoinformation and Cartography , 2006 .

[6]  Jefersson Alex dos Santos,et al.  A Genetic Programming approach for coffee crop recognition , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Francisca López-Granados,et al.  Object- and pixel-based analysis for mapping crops and their agro-environmental associated measures using QuickBird imagery , 2009 .

[8]  Sylvie Philipp-Foliguet,et al.  Multiscale Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[10]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[11]  Txomin Hermosilla,et al.  Assessing contextual descriptive features for plot-based classification of urban areas , 2012 .

[12]  J. R. Jensen,et al.  An automatic region-based image segmentation algorithm for remote sensing applications , 2010, Environ. Model. Softw..

[13]  Ricardo da Silva Torres,et al.  Rotation-Invariant and Scale-Invariant Steerable Pyramid Decomposition for Texture Image Retrieval , 2007, XX Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2007).

[14]  Surya S. Durbha,et al.  Feature Identification via a Combined ICA–Wavelet Method for Image Information Mining , 2010, IEEE Geoscience and Remote Sensing Letters.

[15]  Jianyu Chen,et al.  Image‐object detectable in multiscale analysis on high‐resolution remotely sensed imagery , 2009 .

[16]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[17]  A. Karnieli,et al.  Comparison of methods for land-use classification incorporating remote sensing and GIS inputs , 2011 .

[18]  Weiguo Fan,et al.  Relevance feedback based on genetic programming for image retrieval , 2011, Pattern Recognit. Lett..

[19]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[21]  Timothy A. Warner,et al.  IMAGE CLASSIFICATION WITH A REGION BASED APPROACH IN HIGH SPATIAL RESOLUTION IMAGERY , 2004 .

[22]  J. E. Bendz,et al.  Visually Improved Understanding of Three-Dimensionally Propagating Electromagnetic Fields in Wireless Networks , 2007 .

[23]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jing Li,et al.  Hierarchical object oriented classification using very high resolution imagery and LIDAR data over urban areas , 2009 .

[25]  Ricardo da Silva Torres,et al.  Using relevance feedback for classifying remote sensing images , 2009 .

[26]  A. Tzotsos,et al.  Support Vector Machine Classification for Object-Based Image Analysis , 2008 .

[27]  Giuseppe Scarpa,et al.  Hierarchical Texture-Based Segmentation of Multiresolution Remote-Sensing Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Han-joon Kim,et al.  Combining Active Learning and Boosting for Naïve Bayes Text Classifiers , 2004, WAIM.

[29]  Hong Huo,et al.  A Novel Texture-Preceded Segmentation Algorithm for High-Resolution Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Nicolas Passat,et al.  Spatio-temporal reasoning for the classification of satellite image time series , 2012, Pattern Recognit. Lett..

[31]  A. Tzotsos,et al.  A hybrid texture-based and region-based multi-scale image segmentation algorithm , 2008 .

[32]  Matthieu Cord,et al.  Kernels on Bags of Fuzzy Regions for Fast Object retrieval , 2007, 2007 IEEE International Conference on Image Processing.

[33]  Neucimar J. Leite,et al.  Rotation-Invariant and Scale-Invariant Steerable Pyramid Decomposition for Texture Image Retrieval , 2007 .

[34]  Yashon O. Ouma,et al.  Multiscale remote sensing data segmentation and post-segmentation change detection based on logical modeling: Theoretical exposition and experimental results for forestland cover change analysis , 2008, Comput. Geosci..

[35]  Jon Atli Benediktsson,et al.  A Marker-Based Approach for the Automated Selection of a Single Segmentation From a Hierarchical Set of Image Segmentations , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Surya S. Durbha,et al.  Semantics-enabled framework for knowledge discovery from Earth observation data archives , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Matthieu Cord,et al.  Active Learning Methods for Interactive Image Retrieval , 2008, IEEE Transactions on Image Processing.

[38]  William J. Emery,et al.  Correction to "Active Learning Methods for Remote Sensing Image Classification" [Jul 09 2218-2232] , 2010, IEEE Trans. Geosci. Remote. Sens..

[39]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[40]  Dimitris G. Stavrakoudis,et al.  A Boosted Genetic Fuzzy Classifier for land cover classification of remote sensing imagery , 2011 .

[41]  Haitao Li,et al.  An Efficient Multiscale SRMMHR (Statistical Region Merging and Minimum Heterogeneity Rule) Segmentation Method for High-Resolution Remote Sensing Imagery , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[43]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[44]  P. Gong,et al.  Object-based Detailed Vegetation Classification with Airborne High Spatial Resolution Remote Sensing Imagery , 2006 .

[45]  Jefersson Alex dos Santos,et al.  A relevance feedback method based on genetic programming for classification of remote sensing images , 2011, Inf. Sci..

[46]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Austin Troy,et al.  Object-based land cover classification of shaded areas in high spatial resolution imagery of urban areas: A comparison study , 2009 .

[48]  R. Q. Feitosa,et al.  The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII-4/C7 PER BLOCK URBAN LAND USE INTERPRETATION USING OPTICAL VHR DATA AND THE KNOWLEDGE-BASED SYSTEM INTERIMAGE , 2010 .

[49]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[50]  Farid Melgani,et al.  Support Vector Machine Active Learning Through Significance Space Construction , 2011, IEEE Geoscience and Remote Sensing Letters.

[51]  Nicu Sebe,et al.  Integrating Relevance Feedback in Boosting for Content-Based Image Retrieval , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[52]  Graeme G. Wilkinson,et al.  Results and implications of a study of fifteen years of satellite image classification experiments , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Qi Tian,et al.  Interactive Boosting for Image Classification , 2007, MCAM.

[54]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[55]  T. Warner,et al.  Multi-scale GEOBIA with very high spatial resolution digital aerial imagery: scale, texture and image objects , 2011 .

[56]  Quan Liu,et al.  An Orientation Independent Texture Descriptor for Image Retrieval , 2007, 2007 International Conference on Communications, Circuits and Systems.

[57]  Mario A. Nascimento,et al.  A compact and efficient image retrieval approach based on border/interior pixel classification , 2002, CIKM '02.

[58]  Hai-qing Zhu,et al.  Object-oriented change detection method based on multi-scale and multi-feature fusion , 2009, 2009 Joint Urban Remote Sensing Event.

[59]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[60]  Jocelyn Chanussot,et al.  Processing Multidimensional SAR and Hyperspectral Images With Binary Partition Tree , 2013, Proceedings of the IEEE.

[61]  Michael Unser,et al.  Sum and Difference Histograms for Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Ricardo da Silva Torres,et al.  Content-Based Image Retrieval: Theory and Applications , 2006, RITA.

[63]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[64]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[65]  Hichem Sahli,et al.  A hierarchical Markovian model for multiscale region-based classification of vector-valued images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[66]  Eric Sung,et al.  Improving adaboost for classification on small training sample sets with active learning , 2004 .

[67]  Konstantinos Karantzalos,et al.  Object-based image analysis through nonlinear scale-space filtering , 2011 .