A Local Search-Based GeneSIS algorithm for the Segmentation and Classification of Remote-Sensing Images

A local search-based version of the so-called genetic sequential image segmentation (GeneSIS) algorithm is presented in this paper, for the classification of remotely sensed images. The new method combines the properties of the GeneSIS framework with the principles of the region growing segmentation algorithms. Localized GeneSIS operates on a fine-segmented image obtained after preliminary watershed transformation. Segmentation proceeds by iterative expansions emanating from object cores, i.e., connected components of marked watersheds. At each expansion trial, the process involves three successively performed operations: 1) generation of the object's neighborhood to a specified order; 2) local exploration of the neighborhood through an evolutionary algorithm to identify the best expansion to be merged; and 3) rearrangement of the object neighborhoods. We propose two priority strategies for the selection of the objects to be expanded and two different modes of operation performing either supervised or semisupervised segmentation of the image. The combination of the priority strategies and segmentation modes lead to four different implementations of localized GeneSIS. Due to the local search approach adopted here, the resulting algorithms have considerably lower execution times, while at the same time, they provide comparable classification accuracies compared to those produced by previous GeneSIS variants. Experimental analysis is conducted using a hyperspectral forest image, a multispectral agricultural image, and the Pavia Centre image over an urban area. Comparative results are also provided with existing segmentation algorithms.

[1]  Yuliya Tarabalka,et al.  Spectral-spatial classification of hyperspectral images using hierarchical optimization , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[2]  Paris A. Mastorocostas,et al.  A Region-Based GeneSIS Segmentation Algorithm for the Classification of Remotely Sensed Images , 2015, Remote. Sens..

[3]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[4]  Sylvie Philipp-Foliguet,et al.  Multi-Scale Classification of Remote Sensing Images , 2011 .

[5]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Images Using Minimum Spanning Forest Grown From Automatically Selected Markers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Nikos Koutsias,et al.  SVM-Based Fuzzy Decision Trees for Classification of High Spatial Resolution Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Paris A. Mastorocostas,et al.  Classification of Remotely Sensed Images Using the GeneSIS Fuzzy Segmentation Algorithm , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Liangpei Zhang,et al.  Comparison of Vector Stacking, Multi-SVMs Fuzzy Output, and Multi-SVMs Voting Methods for Multiscale VHR Urban Mapping , 2010, IEEE Geoscience and Remote Sensing Letters.

[9]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[10]  Yuliya Tarabalka,et al.  Best merge region growing with integrated probabilistic classification for hyperspectral imagery , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Konstantinos Karantzalos,et al.  Object-based image analysis through nonlinear scale-space filtering , 2011 .

[12]  Jon Atli Benediktsson,et al.  A Marker-Based Approach for the Automated Selection of a Single Segmentation From a Hierarchical Set of Image Segmentations , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[15]  Sokratis Makrogiannis,et al.  A region dissimilarity relation that combines feature-space and spatial information for color image segmentation , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Nicholas J. Redding,et al.  Implementation of a Fast Algorithm for Segmenting SAR Imagery , 2002 .

[17]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[19]  Yuliya Tarabalka,et al.  Best Merge Region-Growing Segmentation With Integrated Nonadjacent Region Object Aggregation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[20]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[21]  N. Broge,et al.  Comparing prediction power and stability of broadband and hyperspectral vegetation indices for estimation of green leaf area index and canopy chlorophyll density , 2001 .

[22]  Sylvie Philipp-Foliguet,et al.  Multiscale Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Xin Huang,et al.  A multiscale feature fusion approach for classification of very high resolution satellite imagery based on wavelet transform , 2008 .

[24]  Jianping Fan,et al.  Seeded region growing: an extensive and comparative study , 2005, Pattern Recognit. Lett..

[25]  Emanuel Gofman Developing an Efficient Region Growing Engine for Image Segmentation , 2006, 2006 International Conference on Image Processing.

[26]  J. Tilton,et al.  Analysis of hierarchically related image segmentations , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[27]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on a Stochastic Minimum Spanning Forest Approach , 2012, IEEE Transactions on Image Processing.

[28]  Liangpei Zhang,et al.  A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[30]  Guifeng Zhang,et al.  A Scale-Synthesis Method for High Spatial Resolution Remote Sensing Image Segmentation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Delu Pan,et al.  Edge-Guided Multiscale Segmentation of Satellite Multispectral Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Eduardo F. Morales,et al.  Image Segmentation Using Automatic Seeded Region Growing and Instance-Based Learning , 2007, CIARP.

[33]  L. Anselin Local Indicators of Spatial Association—LISA , 2010 .

[34]  Morris Goldberg,et al.  Hierarchy in Picture Segmentation: A Stepwise Optimization Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Shiming Xiang,et al.  A Graph-Based Classification Method for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Silvia Valero Valbuena Hyperspectral image representation and processing with binary partition trees , 2012 .

[37]  Rongjun Qin,et al.  A Mean Shift Vector-Based Shape Feature for Classification of High Spatial Resolution Remotely Sensed Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[39]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[40]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Fernand Meyer,et al.  Topographic distance and watershed lines , 1994, Signal Process..

[42]  Ioannis B. Theocharis,et al.  SVM-FuzCoC: A novel SVM-based feature selection method using a fuzzy complementary criterion , 2010, Pattern Recognit..

[43]  N. Lam,et al.  Wavelets for Urban Spatial Feature Discrimination: Comparisons with Fractal, Spatial Autocorrelation, and Spatial Co-Occurrence Approaches , 2004 .

[44]  Adrian N. Evans,et al.  A morphological gradient approach to color edge detection , 2006, IEEE Transactions on Image Processing.

[45]  Jon Atli Benediktsson,et al.  A Novel MKL Model of Integrating LiDAR Data and MSI for Urban Area Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Jorge Stolfi,et al.  The image foresting transform: theory, algorithms, and applications , 2004 .

[47]  Sung-Bae Cho,et al.  Multiple network fusion using fuzzy logic , 1995, IEEE Trans. Neural Networks.