Scale-variable region-merging for high resolution remote sensing image segmentation

Abstract In high resolution remote sensing imagery (HRI), the sizes of different geo-objects often vary greatly, posing serious difficulties to their successful segmentation. Although existent segmentation approaches have provided some solutions to this problem, the complexity of HRI may still lead to great challenges for previous methods. In order to further enhance the quality of HRI segmentation, this paper proposes a new segmentation algorithm based on scale-variable region merging. Scale-variable means that the scale parameters (SP) adopted for segmentation are adaptively estimated, so that geo-objects of various sizes can be better segmented out. To implement the proposed technique, 3 steps are designed. The first step produces a coarse-segmentation result with slight degree of under segmentation error. This is achieved by segmenting a half size image with the global optimal SP. Such a SP is determined by using the image of original size. In the second step, structural and spatial contextual information is extracted from the coarse-segmentation, enabling the estimation of variable SPs. In the last step, a region merging process is initiated, and the SPs used to terminate this process are estimated based on the information obtained in the second step. The proposed method was tested by using 3 scenes of HRI with different landscape patterns. Experimental results indicated that our approach produced good segmentation accuracy, outperforming some competitive methods in comparison.

[1]  Maciel Zortea,et al.  A supervised approach for simultaneous segmentation and classification of remote sensing images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  Lu Yang,et al.  Semantic Segmentation for High Spatial Resolution Remote Sensing Images Based on Convolution Neural Network and Pyramid Pooling Module , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Li Feng,et al.  Adaptive Scale Selection for Multiscale Segmentation of Satellite Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Jian Yang,et al.  A multi-band approach to unsupervised scale parameter selection for multi-scale image segmentation , 2014 .

[5]  Morris Goldberg,et al.  Hierarchy in Picture Segmentation: A Stepwise Optimization Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jian Yang,et al.  Region Merging Considering Within- and Between-Segment Heterogeneity: An Improved Hybrid Remote-Sensing Image Segmentation Method , 2018, Remote. Sens..

[7]  Bo Chen,et al.  Image Segmentation Based on Constrained Spectral Variance Difference and Edge Penalty , 2015, Remote. Sens..

[8]  Jiangfeng She,et al.  Boundary-constrained multi-scale segmentation method for remote sensing images , 2013 .

[9]  Tengfei Su Efficient paddy field mapping using Landsat-8 imagery and object-based image analysis based on advanced fractel net evolution approach , 2017 .

[10]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[11]  Luisa Verdoliva,et al.  Marker-Controlled Watershed-Based Segmentation of Multiresolution Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Mi Wang,et al.  Optimal Segmentation of High-Resolution Remote Sensing Image by Combining Superpixels With the Minimum Spanning Tree , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[15]  Gang Fu,et al.  Segmentation for High-Resolution Optical Remote Sensing Imagery Using Improved Quadtree and Region Adjacency Graph Technique , 2013, Remote. Sens..

[16]  Shuang Wang,et al.  Context-Based Hierarchical Unequal Merging for SAR Image Segmentation , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Uwe Stilla,et al.  Classification With an Edge: Improving Semantic Image Segmentation with Boundary Detection , 2016, ISPRS Journal of Photogrammetry and Remote Sensing.

[18]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[19]  Christopher Conrad,et al.  Analysis of uncertainty in multi-temporal object-based classification , 2015 .

[20]  Josiane Zerubia,et al.  Multilayer Markov Random Field Models for Change Detection in Optical Remote Sensing Images , 2015 .

[21]  Jian Yang,et al.  Region merging using local spectral angle thresholds: A more accurate method for hybrid segmentation of remote sensing images , 2017 .

[22]  Qihao Weng,et al.  An Automated Method to Parameterize Segmentation Scale by Enhancing Intrasegment Homogeneity and Intersegment Heterogeneity , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Jianhua Liu,et al.  Scale computation on high spatial resolution remotely sensed imagery multi-scale segmentation , 2017 .

[24]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[25]  Dawei Liu,et al.  A Segmentation Method for High Spatial Resolution Remote Sensing Images Based on the Fusion of Multifeatures , 2018, IEEE Geoscience and Remote Sensing Letters.

[26]  Qingquan Li,et al.  Stepwise Evolution Analysis of the Region-Merging Segmentation for Scale Parameterization , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Fan Xia,et al.  Assessing object-based classification: advantages and limitations , 2009 .

[28]  Wenzhong Shi,et al.  Landslide Inventory Mapping From Bitemporal High-Resolution Remote Sensing Images Using Change Detection and Multiscale Segmentation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Shengwei Zhang,et al.  Local and global evaluation for remote sensing image segmentation , 2017 .

[30]  Liang Fan,et al.  Multiscale and Multifeature Segmentation of High-Spatial Resolution Remote Sensing Images Using Superpixels with Mutual Optimal Strategy , 2018, Remote. Sens..

[31]  Xueliang Zhang,et al.  Hybrid region merging method for segmentation of high-resolution remote sensing images , 2014 .

[32]  Hongyu Li,et al.  Image segmentation using mean shift for extracting croplands from high-resolution remote sensing imagery , 2015 .

[33]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[34]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[35]  Julien Michel,et al.  A Scalable Tile-Based Framework for Region-Merging Segmentation , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Yuliya Tarabalka,et al.  Best Merge Region-Growing Segmentation With Integrated Nonadjacent Region Object Aggregation , 2012, IEEE Transactions on Geoscience and Remote Sensing.