Saliency Detection Using Quaternion Sparse Reconstruction

We proposed a visual saliency detection model for color images based on the reconstruction residual of quaternion sparse model in this paper. This algorithm measures saliency of color image region by the reconstruction residual and performs more consistent with visual perception than current sparse models. In current sparse models, they treat the color images as multiple independent channel images and take color image pixel as a scalar entity. Consequently, the important information about interrelationship between color channels is lost during sparse representation. In contrast, the quaternion sparse model treats the color image pixels as a quaternion matrix, completely preserving the inherent color structures during the sparse coding. Therefore, the salient regions can be reliably extracted according to quaternion sparse reconstruction residual since these regions cannot be well approximated using its neighbouring blocks as dictionaries. The proposed saliency detection method achieves better performance on Bruce-Tsotsos dataset and OSIE dataset as compared with traditional sparse reconstruction based models and other state-of-art saliency models. Specifically, our model can achieve higher consistency with human perception without training step and gains higher AUC scores than traditional sparse reconstruction based models.

[1]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[2]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[3]  Pietro Perona,et al.  Is bottom-up attention useful for object recognition? , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Liqing Zhang,et al.  Dynamic visual attention: searching for coding length increments , 2008, NIPS.

[5]  Shuo Wang,et al.  Predicting human gaze beyond pixels. , 2014, Journal of vision.

[6]  Rainer Stiefelhagen,et al.  Predicting human gaze using quaternion DCT image signature saliency and face detection , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[7]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[8]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[10]  Licheng Yu,et al.  Vector Sparse Representation of Color Image Using Quaternion Matrix Analysis , 2015, IEEE Transactions on Image Processing.

[11]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[13]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[14]  John K. Tsotsos,et al.  Attention based on information maximization , 2010 .

[15]  Pietro Perona,et al.  Is bottom-up attention useful for object recognition? , 2004, CVPR 2004.

[16]  Lilong Shi EXPLORATION IN QUATERNION COLOUR , 2005 .

[17]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[18]  Hao Zhu,et al.  Bottom-up saliency based on weighted sparse coding residual , 2011, ACM Multimedia.

[19]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[20]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[21]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[22]  William Rowan Hamilton,et al.  ON QUATERNIONS, OR ON A NEW SYSTEM OF IMAGINARIES IN ALGEBRA , 1847 .

[23]  Yin Li,et al.  Incremental sparse saliency detection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[24]  W. Hamilton II. On quaternions; or on a new system of imaginaries in algebra , 1844 .

[25]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[28]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  R. Farebrother,et al.  Matrix representation of quaternions , 2003 .

[30]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[31]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[32]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[34]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[35]  No Value,et al.  IEEE International Conference on Image Processing , 2003 .

[36]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.