Multi-scale hybrid saliency analysis for region of interest detection in very high resolution remote sensing images

Abstract Researchers have recently been performing region of interest detection in such applications as object recognition, object segmentation, and adaptive coding. In this paper, a novel region of interest detection model that is based on visually salient regions is introduced by utilizing the frequency and space domain features in very high resolution remote sensing images. First, the frequency domain features that are based on a multi-scale spectrum residual algorithm are extracted to yield intensity features. Next, we extract the color and orientation features by generating space dynamic pyramids. Then, spectral features are obtained by analyzing spectral information content. In addition, a multi-scale feature fusion method is proposed to generate a saliency map. Finally, the detected visual saliency regions are described using adaptive threshold segmentation. Compared with existing models, our model eliminates the background information effectively and highlights the salient detected results with well-defined boundaries and shapes. Moreover, an experimental evaluation indicates promising results from our model with respect to the accuracy of detection results.

[1]  Christof Koch,et al.  Comparison of feature combination strategies for saliency-based visual attention systems , 1999, Electronic Imaging.

[2]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[4]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[5]  Xianchuan Yu,et al.  Detection of regions of interest in a high-spatial-resolution remote sensing image based on an adaptive spatial subsampling visual attention model , 2013 .

[6]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[7]  Di Wu,et al.  Computational model for salient object detection with anisotropy. , 2012, Applied optics.

[8]  Lorenzo Bruzzone,et al.  A Novel Protocol for Accuracy Assessment in Classification of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Mohammad S Alam,et al.  Automatic target detection in forward-looking infrared imagery via probabilistic neural networks. , 2009, Applied optics.

[10]  Li Pan,et al.  Local Edge Distributions for Detection of Salient Structure Textures and Objects , 2013, IEEE Geosci. Remote. Sens. Lett..

[11]  Quan Pan,et al.  Dynamic evidential reasoning for change detection in remote sensing images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[12]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[13]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  J. Wolfe,et al.  Changing your mind: on the contributions of top-down and bottom-up guidance in visual search for feature singletons. , 2003, Journal of experimental psychology. Human perception and performance.

[15]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[16]  Lorenzo Bruzzone,et al.  A Novel Protocol for Accuracy Assessment in Classification of Very High Resolution Multispectral and SAR Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[19]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Sukhendu Das,et al.  Use of Salient Features for the Design of a Multistage Framework to Extract Roads From High-Resolution Multispectral Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Thierry Pun,et al.  Attentive mechanisms for dynamic and static scene analysis , 1995 .

[22]  Shumeet Baluja,et al.  Expectation-based selective attention for visual monitoring and control of a robot vehicle , 1997, Robotics Auton. Syst..

[23]  Simone Frintrop,et al.  A Real-time Visual Attention System Using Integral Images , 2007, ICVS 2007.

[24]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[25]  Lihua Yue,et al.  Salient objects detection in time sequenced images , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[26]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[27]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[28]  Yiding Wang,et al.  Salient region detection in high resolution remote sensing images , 2010, The 19th Annual Wireless and Optical Communications Conference (WOCC 2010).

[29]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[30]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[31]  C. Koch,et al.  Models of bottom-up and top-down visual attention , 2000 .

[32]  Guifeng Zhang,et al.  A Scale-Synthesis Method for High Spatial Resolution Remote Sensing Image Segmentation , 2012, IEEE Transactions on Geoscience and Remote Sensing.