A new segmentation method for very high resolution imagery using spectral and morphological information

Image segmentation is a key and prerequisite step for object-based analysis of very high resolution (VHR) imagery. Most existing image segmentation methods use either spectral or spatial information of an image alone. A novel image segmentation method for VHR multispectral images using combined spectral and morphological information is proposed in this paper. The method can be summarized as follows. First, a morphological derivative profile is calculated from an original multispectral image and combined with the spectral bands to quantify spectral-morphological characteristics of a pixel, which are considered as a criterion of homogeneity of neighboring pixels. Image segmentation is then conducted using a seeded region-growing procedure, which is based on the seed points automatically generated from the gradient image and dynamically added and the similarity between a seed pixel and its neighboring pixels in terms of spectral-morphological characteristics. The obtained segmentation result is further refined by a region merging procedure to generate a final segmentation result. The proposed method is evaluated using three VHR images of urban and suburban areas and compared with two existing segmentation methods, in terms of visual inspection, quantitative evaluation and indirect evaluation. Experimental results demonstrate that the joint use of spectral and morphological information outperformed the use of morphological information alone. Furthermore, the proposed image segmentation method performed better than existing methods. The proposed image segmentation method is well applicable to the segmentation of VHR imagery over urban and suburban areas.

[1]  Jonathan Cheung-Wai Chan,et al.  Improved Classification of VHR Images of Urban Areas Using Directional Morphological Profiles , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Jean Louchet,et al.  Using colour, texture, and hierarchial segmentation for high-resolution remote sensing , 2008 .

[3]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[4]  Hamid Soltanian-Zadeh,et al.  Comparison of multiwavelet, wavelet, Haralick, and shape features for microcalcification classification in mammograms , 2004, Pattern Recognit..

[5]  Yun Zhang,et al.  A Supervised and Fuzzy-based Approach to Determine Optimal Multi-resolution Image Segmentation Parameters , 2012 .

[6]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[7]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  A. Rango,et al.  Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico , 2004 .

[10]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[11]  Mustafa Turker,et al.  Building‐based damage detection due to earthquake using the watershed segmentation of the post‐event aerial images , 2008 .

[12]  Tiago H. Silva,et al.  Computer-based identification and tracking of Antarctic icebergs in SAR images , 2005 .

[13]  Peijun Li,et al.  Segmentation of high-resolution multispectral image based on extended morphological profiles , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[14]  Peijun Li,et al.  Multispectral image segmentation by a multichannel watershed‐based approach , 2007 .

[15]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[16]  William J. Emery,et al.  Exploiting SAR and VHR Optical Images to Quantify Damage Caused by the 2003 Bam Earthquake , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Alexandre Carleer,et al.  Assessment of Very High Spatial Resolution Satellite Image Segmentations , 2005 .

[18]  Gökhan Bilgin,et al.  Segmentation of Hyperspectral Images via Subtractive Clustering and Cluster Validation Using One-Class Support Vector Machines , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Andrew Mehnert,et al.  An improved seeded region growing algorithm , 1997, Pattern Recognit. Lett..

[20]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  J. Briggs,et al.  An Object-oriented Approach to Urban Forest Mapping in Phoenix , 2007 .

[22]  Frank Y. Shih,et al.  Automatic seeded region growing for color image segmentation , 2005, Image Vis. Comput..

[23]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  D. Civco,et al.  Optimizing multi-resolution segmentation scale using empirical methods: Exploring the sensitivity of the supervised discrepancy measure Euclidean distance 2 (ED2) , 2014 .

[25]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[26]  Siddheswar Ray,et al.  Determination of Number of Clusters in K-Means Clustering and Application in Colour Image Segmentation , 2000 .

[27]  Hermann Kaufmann,et al.  Fusion of spectral and shape features for identification of urban surface cover types using reflective and thermal hyperspectral data , 2003 .

[28]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[29]  Antonio J. Plaza,et al.  Spatial/spectral endmember extraction by multidimensional morphological operations , 2002, IEEE Trans. Geosci. Remote. Sens..

[30]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[31]  Huseyin Gokhan Akcay,et al.  Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Curtis E. Woodcock,et al.  Nested-hierarchical scene models and image segmentation , 1992 .

[33]  Mark Q. Shaw,et al.  Automatic Image Segmentation by Dynamic Region Growth and Multiresolution Merging , 2009, IEEE Transactions on Image Processing.

[34]  J. R. Jensen,et al.  An automatic region-based image segmentation algorithm for remote sensing applications , 2010, Environ. Model. Softw..

[35]  Peijun Li,et al.  A Multilevel Hierarchical Image Segmentation Method for Urban Impervious Surface Mapping Using Very High Resolution Imagery , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Daniel P. Huttenlocher,et al.  A multi-resolution technique for comparing images using the Hausdorff distance , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Martien Molenaar,et al.  Terrain objects, their dynamics and their monitoring by the integration of GIS and remote sensing , 1995, IEEE Trans. Geosci. Remote. Sens..

[38]  Gilberto Câmara,et al.  Spring: integrating remote sensing and gis by object-oriented data modelling , 1996, Comput. Graph..

[39]  Daniel L. Civco,et al.  Evaluation of data fusion and image segmentation in earth observation based rapid mapping workflows , 2014 .

[40]  Laurent Durieux,et al.  A method for monitoring building construction in urban sprawl areas using object-based analysis of Spot 5 images and existing GIS data , 2008 .

[41]  G. Meinel,et al.  EVALUATION OF SEGMENTATION PROGRAMS FOR HIGH RESOLUTION REMOTE SENSING APPLICATIONS , 2003 .

[42]  Marvin E. Bauer,et al.  Integrating Contextual Information with per-Pixel Classification for Improved Land Cover Classification , 2000 .

[43]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[44]  J. Schiewe,et al.  SEGMENTATION OF HIGH-RESOLUTION REMOTELY SENSED DATA - CONCEPTS, APPLICATIONS AND PROBLEMS , 2002 .

[45]  Aggelos K. Katsaggelos,et al.  Hybrid image segmentation using watersheds and fast region merging , 1998, IEEE Trans. Image Process..

[46]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[47]  Dong-Gyu Sim,et al.  Object matching algorithms using robust Hausdorff distance measures , 1999, IEEE Trans. Image Process..

[48]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[49]  Antonio J. Plaza,et al.  A new approach to mixed pixel classification of hyperspectral imagery based on extended morphological profiles , 2004, Pattern Recognit..

[50]  Curt H. Davis,et al.  Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information , 2005, EURASIP J. Adv. Signal Process..

[51]  Yun Zhang,et al.  Region based segmentation of QuickBird multispectral imagery through band ratios and fuzzy comparison , 2009 .

[52]  Jianping Fan,et al.  Seeded region growing: an extensive and comparative study , 2005, Pattern Recognit. Lett..

[53]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[54]  William Rucklidge,et al.  Efficiently Locating Objects Using the Hausdorff Distance , 1997, International Journal of Computer Vision.

[55]  Wenjun Chen,et al.  A semi-automatic segmentation procedure for feature extraction in remotely sensed imagery , 2005, Comput. Geosci..

[56]  G. Foody Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[57]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .