Region-based retrieval of remote sensing image patches with adaptive image segmentation

Over the past four decades, the satellite imaging sensors have acquired huge quantities of Earth- observation data. Content-based image retrieval allows for fast and effective queries of remote sensing images. Here, we take the following two issues into consideration. Firstly, different features and their combination should be chosen for different land covers. Secondly, for the block dividing strategy and the complexities of the remote sensing images, it can not effectively retrieve some small target areas scattered in multiple nontarget blocks. Aiming at the above two issues, a new region-based retrieval method with adaptive image segmentation is proposed. In order to improve the accuracy of remote sensing image segmentation, feature selection and weighing is performed by two-stage clustering, and image segmentation is accomplished based on the chosen features and mean shift procedure. Meanwhile, for the homogeneous characteristics of remote sensing land covers, a new regional representation and matching scheme are adopted to perform image retrieval. Experimental results on retrieving various land covers show that the method can avoid the impact of traditional blocking strategies, and can achieve an average percentage of 19% higher precision with the same level of recall rate, than the relevance feedback method for small target areas.

[1]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[4]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yiannis Aloimonos,et al.  An Experimental Study of Color-Based Segmentation Algorithms Based on the Mean-Shift Concept , 2010, ECCV.

[6]  Chi Hau Chen,et al.  Statistical pattern recognition in remote sensing , 2008, Pattern Recognit..

[7]  Ram M. Narayanan,et al.  Integrated spectral and spatial information mining in remote sensing imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[9]  Marco Pastori,et al.  Information mining in remote sensing image archives: system concepts , 2003, IEEE Trans. Geosci. Remote. Sens..

[10]  Mihai Datcu,et al.  Query by image content and information mining , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[11]  Mihai Datcu,et al.  Interactive learning and probabilistic retrieval in remote sensing image archives , 2000, IEEE Trans. Geosci. Remote. Sens..

[12]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[13]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hyeran Byun,et al.  FRIP: a region-based image retrieval tool using automatic image segmentation and stepwise Boolean AND matching , 2005, IEEE Transactions on Multimedia.

[15]  Horst Bischof,et al.  MDL Principle for Robust Vector Quantisation , 1999, Pattern Analysis & Applications.

[16]  Yixin Chen,et al.  A Region-Based Fuzzy Feature Matching Approach to Content-Based Image Retrieval , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[18]  Selim Aksoy,et al.  Modeling of Remote Sensing Image Content Using Attributed Relational Graphs , 2006, SSPR/SPR.

[19]  M. Schroder,et al.  Query by image content from remote sensing archives , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[20]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Ilan Shimshoni,et al.  Mean shift based clustering in high dimensions: a texture classification example , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Meritxell Bach Cuadra,et al.  Region-based satellite image classification: method and validation , 2005, IEEE International Conference on Image Processing 2005.

[26]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[27]  Shuang Wang,et al.  Mean Shift Based Adaptive Texture Image Segmentation Method: Mean Shift Based Adaptive Texture Image Segmentation Method , 2010 .

[28]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Bo Zhang,et al.  An efficient and effective region-based image retrieval framework , 2004, IEEE Transactions on Image Processing.

[30]  Kyuseok Shim,et al.  WALRUS: A Similarity Retrieval Algorithm for Image Databases , 2004, IEEE Trans. Knowl. Data Eng..

[31]  Jianqiang Yi,et al.  Improved mean shift segmentation approach for natural images , 2007, Appl. Math. Comput..

[32]  Mihai Datcu,et al.  Information mining in remote sensing image archives: system evaluation , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jia Li,et al.  Large-scale Satellite Image Browsing using Automatic Semantic Categorization , 2005, Tenth IEEE International Conference on Computer Vision Workshops (ICCVW'05).

[34]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).