Extraction of complex patterns from multiresolution remote sensing images: A hierarchical top-down methodology

The extraction of urban patterns from very high spatial resolution (VHSR) optical images presents several challenges related to the size, the accuracy and the complexity of the considered data. Based on the availability of several optical images of a same scene at various resolutions (medium, high, and very high spatial resolution), a hierarchical approach is proposed to progressively extract segments of interest from the lowest to the highest resolution data, and then finally determine urban patterns from VHSR images. This approach, inspired by the principle of photo-interpretation, has for purpose to use as much as possible the user's skills while minimising his/her interaction. In order to do so, at each resolution, an interactive segmentation of one sample region is required for each semantic class of the image. Then, the user's behaviour is automatically reproduced in the remainder of the image. This process is mainly based on tree-cuts in binary partition trees. Since it strongly relies on user-defined segmentation examples, it can involve only low level-spatial and radiometric-criteria, then enabling fast computation of comprehensive results. Experiments performed on urban images datasets provide satisfactory results which may be further used for classification purpose.

[1]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[2]  S. Barr,et al.  Distinguishing urban land-use categories in fine spatial resolution land-cover data using a graph-based, structural pattern recognition system , 1997 .

[3]  Christiane Weber,et al.  The Utility of Very High Spatial Resolution Images to Identify Urban Objects , 2002 .

[4]  Germain Forestier,et al.  Multiresolution Remote Sensing Image Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[5]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[7]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[8]  Luc Brun,et al.  A Causal Extraction Scheme in Top-Down Pyramids for Large Images Segmentation , 2010, SSPR/SPR.

[9]  Julien Michel,et al.  Qualitative Spatial Reasoning for High-Resolution Remote Sensing Image Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Philippe Salembier,et al.  Connected operators and pyramids , 1993, Optics & Photonics.

[11]  Luc Brun,et al.  Tiled top–down combinatorial pyramids for large images representation , 2011, Int. J. Imaging Syst. Technol..

[12]  S. Aksoy,et al.  Multi-resolution segmentation and shape analysis for remote sensing image classification , 2005, Proceedings of 2nd International Conference on Recent Advances in Space Technologies, 2005. RAST 2005..

[13]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[15]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[16]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[17]  A. Rosenfeld,et al.  Image Segmentation by Texture Using Pyramid Node Linking. , 1981 .

[18]  M. Baatz,et al.  Progressing from object-based to object-oriented image analysis , 2008 .

[19]  Josiane Zerubia,et al.  A Hierarchical Finite-State Model for Texture Segmentation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[20]  Selim Aksoy,et al.  Performance measures for object detection evaluation , 2010, Pattern Recognit. Lett..

[21]  Germain Forestier,et al.  Multisource Images Analysis Using Collaborative Clustering , 2008, EURASIP J. Adv. Signal Process..

[22]  Philippe Kubik,et al.  PLEIADES-HR IMAGE SYSTEM PRODUCTS AND QUALITY PLEIADES-HR IMAGE SYSTEM PRODUCTS AND GEOMETRIC ACCURACY , 2005 .

[23]  Pierre Soille,et al.  Constrained connectivity for the processing of very-high-resolution satellite images , 2010 .

[24]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[25]  Stéphane Mallat,et al.  Wavelets for a vision , 1996, Proc. IEEE.

[26]  A.J. Plaza,et al.  Automated selection of results in hierarchical segmentations of remotely sensed hyperspectral images , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[27]  Gang Xu,et al.  Information fusion for rural land-use classification with high-resolution satellite imagery , 2003, IEEE Trans. Geosci. Remote. Sens..

[28]  David García,et al.  Extensive operators in partition lattices for image sequence analysis , 1998, Signal Process..

[29]  Nicolas Passat,et al.  Hierarchical Segmentation of Multiresolution Remote Sensing Images , 2011, ISMM.

[30]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jocelyn Chanussot,et al.  New hyperspectral data representation using binary partition tree , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Jordi Inglada,et al.  Automatic recognition of man-made objects in high resolution optical remote sensing images by SVM classification of geometric image features , 2007 .

[33]  Chin-Chuan Han,et al.  Multisource Data Fusion for Landslide Classification Using Generalized Positive Boolean Functions , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Verónica Vilaplana,et al.  Binary Partition Trees for Object Detection , 2008, IEEE Transactions on Image Processing.

[35]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[36]  Morris Goldberg,et al.  Hierarchy in Picture Segmentation: A Stepwise Optimization Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  M.H.F. Wilkinson,et al.  Connected operators , 2009, IEEE Signal Processing Magazine.

[38]  Hervé Le Men,et al.  The hierarchy of the cocoons of a graph and its application to image segmentation , 2003, Pattern Recognit. Lett..

[39]  Jan Sijbers,et al.  Multiscale watershed segmentation of multivalued images , 2002, Object recognition supported by user interaction for service robots.

[40]  J. Tilton,et al.  Analysis of hierarchically related image segmentations , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[41]  Nicolas Passat,et al.  Multi-resolution region-based clustering for urban analysis , 2010 .

[42]  Sung-Hyuk Cha,et al.  On measuring the distance between histograms , 2002, Pattern Recognit..

[43]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Giuseppe Scarpa,et al.  Hierarchical Texture-Based Segmentation of Multiresolution Remote-Sensing Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[45]  D. Donoghue Remote sensing: sensors and applications , 2000 .

[46]  Youcef Chibani Selective Synthetic Aperture Radar and Panchromatic Image Fusion by Using the à Trous Wavelet Decomposition , 2005, EURASIP J. Adv. Signal Process..

[47]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[48]  Jong Bae Kim,et al.  Multiresolution-based watersheds for efficient image segmentation , 2003, Pattern Recognit. Lett..

[49]  Pascal Monasse,et al.  Scale-Space from a Level Lines Tree , 2000, J. Vis. Commun. Image Represent..

[50]  Huseyin Gokhan Akcay,et al.  Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations , 2008, IEEE Transactions on Geoscience and Remote Sensing.