Moving visual focus in salient object segmentation

Saliency detection plays an important role in image segmentation, object detection and retrieval, which attracts more attention in the field of computer vision recently. Most existing saliency detection algorithms have not considered the influence of visual focus (VF) shifting yet. In this study, a novel algorithm named moving region contrast (MRC) is proposed to analyse image saliency. The algorithm MRC is built on a novel concept of moving VF. The initial VF is defined as the geometric centre of the image. Then the VF is calculated iteratively by focus-moving technique where a saliency gravitation model is employed to determine the moving direction. The salient region is obtained according to the final VF. The experiments are conducted on the dataset with 1000 images released by Achanta. Experimental results show that the proposed algorithm achieves marked improvements in performance and outperforms other 11 popular algorithms.

[1]  Peter Auer,et al.  Object recognition using segmentation for feature detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jian-Jiun Ding,et al.  Salient Region Detection Improved by Principle Component Analysis and Boundary Information , 2013, IEEE Transactions on Image Processing.

[4]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[6]  Touradj Ebrahimi,et al.  The JPEG2000 still image coding system: an overview , 2000, IEEE Trans. Consumer Electron..

[7]  Guoliang Fan,et al.  Selecting Salient Frames for Spatiotemporal Video Modeling and Segmentation , 2007, IEEE Transactions on Image Processing.

[8]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[10]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[11]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Simone Frintrop,et al.  A Real-time Visual Attention System Using Integral Images , 2007, ICVS 2007.

[13]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[14]  Kristen Grauman,et al.  Shape Sharing for Object Segmentation , 2012, ECCV.

[15]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[18]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[19]  Christof Koch,et al.  Attentional Selection for Object Recognition - A Gentle Way , 2002, Biologically Motivated Computer Vision.

[20]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[21]  David S. Doermann,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Signature Detection and Matching , 2022 .

[22]  Jian Yang,et al.  Saliency-based localising active contour for automatic natural object segmentation , 2013 .

[23]  Nicu Sebe,et al.  Sparse Color Interest Points for Image Retrieval and Object Categorization , 2012, IEEE Transactions on Image Processing.

[24]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.

[25]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[26]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[27]  I. Patras,et al.  Spatiotemporal salient points for visual recognition of human actions , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Xuelong Li,et al.  Enhanced Biologically Inspired Model for Object Recognition , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  King Ngi Ngan,et al.  A Co-Saliency Model of Image Pairs , 2011, IEEE Transactions on Image Processing.

[30]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[31]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[32]  Dacheng Tao,et al.  Enhanced Biologically Inspired Model for Object Recognition. , 2011, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society.

[33]  Wen Gao,et al.  Visual Saliency Computation: A Machine Learning Perspective , 2014 .

[34]  Yoshinori Hara,et al.  On image segmentation for object-based image retrieval , 2002, Object recognition supported by user interaction for service robots.

[35]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[37]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.