Saliency Detection for Stereoscopic 3D Images in the Quaternion Frequency Domain

Recent studies have shown that a remarkable distinction exists between human binocular and monocular viewing behaviors. Compared with two-dimensional (2D) saliency detection models, stereoscopic three-dimensional (S3D) image saliency detection is a more challenging task. In this paper, we propose a saliency detection model for S3D images. The final saliency map of this model is constructed from the local quaternion Fourier transform (QFT) sparse feature and global QFT log-Gabor feature. More specifically, the local QFT feature measures the saliency map of an S3D image by analyzing the location of a similar patch. The similar patch is chosen using a sparse representation method. The global saliency map is generated by applying the wake edge-enhanced gradient QFT map through a band-pass filter. The results of experiments on two public datasets show that the proposed model outperforms existing computational saliency models for estimating S3D image saliency.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  Weisi Lin,et al.  Saliency detection for stereoscopic images , 2013, 2013 Visual Communications and Image Processing (VCIP).

[3]  Weisi Lin,et al.  A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform , 2013, IEEE Transactions on Multimedia.

[4]  T. Ell,et al.  Quaternion-Fourier transforms for analysis of two-dimensional linear time-invariant partial differential systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[5]  Bu-Sung Lee,et al.  Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum , 2012, IEEE Transactions on Multimedia.

[6]  Yang Liu,et al.  Depth-aware salient object detection using anisotropic center-surround difference , 2015, Signal Process. Image Commun..

[7]  Brejesh Lall,et al.  Adaptive image compression using saliency and KAZE features , 2016, 2016 International Conference on Signal Processing and Communications (SPCOM).

[8]  Junle Wang,et al.  Computational Model of Stereoscopic 3D Visual Saliency , 2013, IEEE Transactions on Image Processing.

[9]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Gangyi Jiang,et al.  A depth perception and visual comfort guided computational model for stereoscopic 3D visual saliency , 2015, Signal Process. Image Commun..

[11]  Mihai Mitrea,et al.  MPEG-4 AVC stream-based saliency detection. Application to robust watermarking , 2018, Signal Process. Image Commun..

[12]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[13]  Xu Wang,et al.  Deep Learning Features Inspired Saliency Detection of 3D Images , 2016, PCM.

[14]  Stephen J. Sangwine,et al.  Hypercomplex Fourier Transforms of Color Images , 2007, IEEE Trans. Image Process..

[15]  Aoxue Li,et al.  Global and Local Saliency Analysis for the Extraction of Residential Areas in High-Spatial-Resolution Remote Sensing Image , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Hongyu Li,et al.  SDSP: A novel saliency detection method by combining simple priors , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Feng Qi,et al.  3D visual saliency detection model with generated disparity map , 2016, Multimedia Tools and Applications.

[18]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[19]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[20]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[21]  Nader Karimi,et al.  Image retargeting using depth assisted saliency map , 2017, Signal Process. Image Commun..

[22]  S. Sangwine.  Fourier transforms of colour images using quaternion or hypercomplex, numbers , 1996 .

[23]  W. Hamilton.  II. On quaternions; or on a new system of imaginaries in algebra , 1844 .

[24]  W. Ma,et al.  Perceived duration is reduced by repetition but not by high-level expectation. , 2015, Journal of vision.

[25]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Harish Katti,et al.  Depth Matters: Influence of Depth Cues on Visual Saliency , 2012, ECCV.

[27]  Yin Li,et al.  Incremental sparse saliency detection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[28]  Weisi Lin,et al.  Learning visual saliency from human fixations for stereoscopic images , 2017, Neurocomputing.

[29]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Zhihan Lv,et al.  Stereoscopic image quality assessment method based on binocular combination saliency model , 2016, Signal Process..

[31]  William Rowan Hamilton,et al.  ON QUATERNIONS, OR ON A NEW SYSTEM OF IMAGINARIES IN ALGEBRA , 1847 .

[32]  Hsueh-Ming Hang,et al.  Learning-based saliency model with depth information. , 2015, Journal of vision.

[33]  Weisi Lin,et al.  Saliency Detection in the Compressed Domain for Adaptive Image Retargeting , 2012, IEEE Transactions on Image Processing.

[34]  Minghui Wang,et al.  RGB-D Salient Object Detection via Minimum Barrier Distance Transform and Saliency Fusion , 2017, IEEE Signal Processing Letters.

[35]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[36]  N. Vasconcelos,et al.  Biologically plausible saliency mechanisms improve feedforward object recognition , 2010, Vision Research.