Saliency threshold: a novel saliency detection model using Ising’s theory on Ferromagnetism (STIF)

With the advancement of time, the computer vision systeams are focusing on mimicking the human visual system. In this manuscript, we tried to develop a model which works at improving both the detection accuracy and computation time. First, two double opponent color based features and twelve directional edge features using Gabor filter are computed. Then the most dominant feature pertaining to the salient object is extracted using principal component analysis to form the saliency map. Further, a threshold is applied on the saliency map to detect the salient object present in the image. This threshold selection is a vital procedure. We mapped the Ising model of ferromagnetism to the salient object detection problem by employing an optimization problem for this threshold selection. Experimental results show that the proposed model outperforms the existing models in terms of detection accuracy and also takes less computation time in comparison to many methods.

[1]  Armin B. Cremers,et al.  A Multisize Superpixel Approach for Salient Object Detection Based on Multivariate Normal Distribution Estimation , 2014, IEEE Transactions on Image Processing.

[2]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[4]  C. Koch,et al.  Models of bottom-up and top-down visual attention , 2000 .

[5]  Amel Benazza-Benyahia,et al.  Efficient transform-based texture image retrieval techniques under quantization effects , 2016, Multimedia Tools and Applications.

[6]  Xiaochun Cao,et al.  Cluster-Based Co-Saliency Detection , 2013, IEEE Transactions on Image Processing.

[7]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[8]  Wei Zhang,et al.  An Adaptive Computational Model for Salient Object Detection , 2010, IEEE Transactions on Multimedia.

[9]  Wenbin Zou,et al.  Saliency Tree: A Novel Saliency Detection Framework , 2014, IEEE Transactions on Image Processing.

[10]  Laurent Itti,et al.  Saliency and Gist Features for Target Detection in Satellite Images , 2011, IEEE Transactions on Image Processing.

[11]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[13]  Navjot Singh,et al.  SEAM - an improved environmental adaptation method with real parameter coding for salient object detection , 2020, Multimedia Tools and Applications.

[14]  Ben Wang,et al.  Reverse Attention for Salient Object Detection , 2018, ECCV.

[15]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Volker Graefe,et al.  A novel approach for the detection of vehicles on freeways by real-time vision , 1996, Proceedings of Conference on Intelligent Vehicles.

[17]  Shuhan Chen,et al.  Reverse Attention-Based Residual Network for Salient Object Detection , 2020, IEEE Transactions on Image Processing.

[18]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Tiantian Wang,et al.  A Multistage Refinement Network for Salient Object Detection , 2020, IEEE Transactions on Image Processing.

[21]  Yueting Zhuang,et al.  Saliency Detection within a Deep Convolutional Architecture , 2014, AAAI 2014.

[22]  King Ngi Ngan,et al.  Unsupervised extraction of visual attention objects in color images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Xiaogang Wang,et al.  Saliency detection by multi-context deep learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Zhiwen Yu,et al.  A Rule Based Technique for Extraction of Visual Attention Regions Based on Real-Time Clustering , 2007, IEEE Transactions on Multimedia.

[25]  R. K. Agrawal,et al.  Combination of Kullback–Leibler divergence and Manhattan distance measures to detect salient objects , 2015, Signal Image Video Process..

[26]  Nico Karssemeijer,et al.  Detection of stellate distortions in mammograms , 1996, IEEE Trans. Medical Imaging.

[27]  King Ngi Ngan,et al.  Unsupervised Salient Object Segmentation Based on Kernel Density Estimation and Two-Phase Graph Cut , 2012, IEEE Transactions on Multimedia.

[28]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[29]  Ali Borji,et al.  Salient object detection: A survey , 2014, Computational Visual Media.

[30]  Jingdong Wang,et al.  Salient Object Detection: A Discriminative Regional Feature Integration Approach , 2013, International Journal of Computer Vision.

[31]  Marko Tscherepanow,et al.  A saliency map based on sampling an image into random rectangular regions of interest , 2012, Pattern Recognit..

[32]  Ling Shao,et al.  Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[33]  R. K. Agrawal,et al.  A novel position prior using fusion of rule of thirds and image center for salient object detection , 2016, Multimedia Tools and Applications.

[34]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[35]  Ling Shao,et al.  Saliency-aware image-to-class distances for image classification , 2015, Neurocomputing.

[36]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[37]  R. K. Agrawal,et al.  A convex hull approach in conjunction with Gaussian mixture model for salient object detection , 2016, Digit. Signal Process..

[38]  R. K. Agrawal,et al.  A novel approach to combine features for salient object detection using constrained particle swarm optimization , 2014, Pattern Recognit..

[39]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.

[40]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[41]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[44]  R. K. Agrawal,et al.  Performance enhancement of salient object detection using superpixel based Gaussian mixture model , 2018, Multimedia Tools and Applications.

[45]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  E. Ising.  Beitrag zur Theorie des Ferromagnetismus , 1925 .

[47]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[48]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[49]  Weisi Lin,et al.  A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform , 2013, IEEE Transactions on Multimedia.