Salient object detection based on regions

Salient object detection aims to automatically localize the attractive objects with respect to surrounding background in an image. It can be applied to image browsing, image cropping, image compression, content-based image retrieval, and etc. In the literature, the low-level (pixel-based) features (e.g., color and gradient) were usually adopted for modeling and computing visual attention; these methods are straightforward and efficient but limited by performance, due to losing global organization and inference. Some recent works attempt to use the region-based features but often lead to incomplete object detection. In this paper, we propose an efficient approach of salient object detection using region-based representation, in which two novel region-based features are extracted for proposing salient map and the salient object are localized with a region growing algorithm. Its brief procedure includes: 1) image segmentation to get disjoint regions with characteristic consistency; 2) region clustering; 3) computation of the region-based center-surround feature and color-distribution feature; 4) combination of the two features to propose the saliency map; 5) region growing for detecting salient object. In the experiments, we evaluate our method with the public dataset provided by Microsoft Research Asia. The experimental results show that the new approach outperforms other four state-of-the-arts methods with regard to precision, recall and F-measure.

[1]  Jake Porway,et al.  A stochastic graph grammar for compositional object representation and recognition , 2009, Pattern Recognit..

[2]  Yongtian Wang,et al.  An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Gabriela Csurka,et al.  A framework for visual saliency detection with applications to image thumbnailing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[6]  Hichem Sahli,et al.  Modeling Attention and Perceptual Grouping to Salient Objects , 2008, WAPCV.

[7]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Fred Stentiford,et al.  Attention Based Auto Image Cropping , 2007, ICVS 2007.

[9]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[10]  Deepu Rajan,et al.  Salient Region Detection by Modeling Distributions of Color and Orientation , 2009, IEEE Transactions on Multimedia.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[13]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[14]  H. Nothdurft Salience from feature contrast: additivity across dimensions , 2000, Vision Research.

[15]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[16]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Nenghai Yu,et al.  Fast Salient Object Detection Based on Segments , 2009, 2009 International Conference on Measuring Technology and Mechatronics Automation.

[18]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[19]  Simone Frintrop,et al.  Goal-Directed Search with a Top-Down Modulated Computational Attention System , 2005, DAGM-Symposium.

[20]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Liang Lin,et al.  Representing and recognizing objects with massive local image patches , 2012, Pattern Recognit..

[22]  Dattaguru V Kamat A framework for visual saliency detection with applications to image thumbnailing , 2009 .

[23]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  H. Nothdurft Salience from feature contrast: variations with texture density , 2000, Vision Research.

[26]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Wei Zhang,et al.  Adaptive semantic Bayesian framework for image attention , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  Ying Sun,et al.  A hierarchical approach to color image segmentation using homogeneity , 2000, IEEE Trans. Image Process..

[29]  F. Pellandini,et al.  Adaptive color image compression based on visual attention , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[30]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[31]  Liang Lin,et al.  Layered Graph Matching with Composite Cluster Sampling , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Julian F. Y. Cheung,et al.  Directional line detectors in correlated noisy environments , 2000, IEEE Trans. Image Process..

[33]  Hyeran Byun,et al.  Extracting Salient Regions And Learning Importance Scores In Region-Based Image Retrieval , 2003, Int. J. Pattern Recognit. Artif. Intell..

[34]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[35]  Robert B. Fisher,et al.  Object-based visual attention for computer vision , 2003, Artif. Intell..

[36]  Hichem Sahli,et al.  Region-Oriented Visual Attention Framework for Activity Detection , 2008, WAPCV.