Object-based image analysis through nonlinear scale-space filtering

In this research, an object-oriented image classification framework was developed which incorporates nonlinear scale-space filtering into the multi-scale segmentation and classification procedures. Morphological levelings, which possess a number of desired spatial and spectral properties, were associated with anisotropically diffused markers towards the construction of nonlinear scale spaces. Image objects were computed at various scales and were connected to a kernel-based learning machine for the classification of various earth-observation data from both active and passive remote sensing sensors. Unlike previous object-based image analysis approaches, the scale hierarchy is implicitly derived from scale-space representation properties. The developed approach does not require the tuning of any parameter—of those which control the multi-scale segmentation and object extraction procedure, like shape, color, texture, etc. The developed object-oriented image classification framework was applied on a number of remote sensing data from different airborne and spaceborne sensors including SAR images, high and very high resolution panchromatic and multispectral aerial and satellite datasets. The very promising experimental results along with the performed qualitative and quantitative evaluation demonstrate the potential of the proposed approach.

[1]  Atsushi Imiya,et al.  Linear Scale-Space has First been Proposed in Japan , 1999, Journal of Mathematical Imaging and Vision.

[2]  G. Hay,et al.  A Multiscale Object-Specific Approach to Digital Change Detection , 2003 .

[3]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[4]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[5]  Thomas Blaschke,et al.  Optimization of scale and parametrization for terrain segmentation: An application to soil-landscape modeling , 2009, Comput. Geosci..

[6]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Grégoire Mercier,et al.  Classification of hyperspectral images with nonlinear filtering and support vector machines , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[8]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[9]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[10]  Thomas Blaschke,et al.  Object-oriented image analysis and scale-space: Theory and methods for modeling and evaluating multi-scale landscape structure , 2001 .

[11]  G. Mercier,et al.  Support vector machines for hyperspectral image classification with spectral-based kernels , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[12]  Thomas Blaschke,et al.  A comparison of three image-object methods for the multiscale analysis of landscape structure , 2003 .

[13]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[14]  C. Harlow,et al.  Computational image interpretation models : an overview and a perspective , 1990 .

[15]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Alexandre Carleer,et al.  Assessment of Very High Spatial Resolution Satellite Image Segmentations , 2005 .

[17]  Petros Maragos,et al.  Nonlinear Scale-Space Representation with Morphological Levelings , 2000, J. Vis. Commun. Image Represent..

[18]  Fernand Meyer,et al.  From connected operators to levelings , 1998 .

[19]  Jean Paul Frédéric Serra.  Connections for sets and functions , 2000, Fundam. Informaticae.

[20]  Austin Troy,et al.  Object-based land cover classification of shaded areas in high spatial resolution imagery of urban areas: A comparison study , 2009 .

[21]  Fernand Meyer,et al.  Levelings, Image Simplification Filters for Segmentation , 2004, Journal of Mathematical Imaging and Vision.

[22]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .

[23]  G. Hay,et al.  An automated object-based approach for the multiscale image segmentation of forest scenes , 2005 .

[24]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[25]  Nikos Paragios,et al.  Comparing morphological levelings constrained by different markers , 2007, ISMM.

[26]  Konstantinos Karantzalos,et al.  Improving edge detection and watershed segmentation with anisotropic diffusion and morphological levellings , 2006 .

[27]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[29]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[30]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[31]  Thomas Blaschke,et al.  Image Segmentation Methods for Object-based Analysis and Classification , 2004 .

[32]  John I. Goutsias,et al.  Mathematical Morphology and its Applications to Image and Signal Processing , 2000, Computational Imaging and Vision.

[33]  Thomas Blaschke,et al.  A Method for adapting global image segmentation methods to images of different resolutions , 2008 .

[34]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[35]  Angelos Tzotsos,et al.  MSEG: A GENERIC REGION-BASED MULTI-SCALE IMAGE SEGMENTATION ALGORITHM FOR REMOTE SENSING IMAGERY , 2006 .

[36]  Guillermo Sapiro,et al.  Multiscale Representation and Segmentation of Hyperspectral Imagery Using Geometric Partial Differential Equations and Algebraic Multigrid Methods , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[37]  A. Tzotsos,et al.  A hybrid texture-based and region-based multi-scale image segmentation algorithm , 2008 .

[38]  Yashon O. Ouma,et al.  Multiscale remote sensing data segmentation and post-segmentation change detection based on logical modeling: Theoretical exposition and experimental results for forestland cover change analysis , 2008, Comput. Geosci..

[39]  Emmanuel Arzuaga-Cruz,et al.  Integration of spatial and spectral information by means of unsupervised extraction and classification for homogenous objects applied to multispectral and hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[40]  G. Hay,et al.  Object-Based Image Analysis , 2008 .

[41]  Yu Liu,et al.  A framework of region-based spatial relations for non-overlapping features and its application in object based image analysis , 2008 .

[42]  Paul L. Rosin,et al.  Multiscale structure in sedimentary basins , 2004 .

[43]  Geoffrey M. Smith,et al.  Advances in Object-based Image Classification , 2008 .

[44]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[45]  G. Hay,et al.  A scale-space primer for exploring and quantifying complex landscapes , 2002 .

[46]  M. Neubert,et al.  EVALUATION OF REMOTE SENSING IMAGE SEGMENTATION QUALITY – FURTHER RESULTS AND CONCEPTS , 2006 .

[47]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[48]  A. Tzotsos,et al.  Support Vector Machine Classification for Object-Based Image Analysis , 2008 .

[49]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[50]  Miguel Velez-Reyes,et al.  Comparative Study of Semi-Implicit Schemes for Nonlinear Diffusion in Hyperspectral Imagery , 2007, IEEE Transactions on Image Processing.