Stereoscopic Visual Attention Guided Seam Carving for Stereoscopic Image Retargeting

Stereoscopic image retargeting plays an important role in adaptive 3D stereoscopic displays. It aims to fit displays with various resolutions while preserving visually salient content and geometric consistency. We propose a stereoscopic image retargeting method based on stereoscopic visual attention guided seam carving. Firstly, stereoscopic saliency map is generated by combining 2D saliency and depth saliency maps, and significant energy map is generated by considering binocular disparity binocular and binocular just-noticeable-difference (BJND). Then, seam selection is applied to the left image based on stereoscopic saliency and energy maps, and seam replacement is performed for the occluded regions to prevent the geometry inconsistency. Finally, according to the matched left and right seams, the retargeted stereoscopic image is generated. In the experiments, subjective and objective analysis on three stereoscopic image databases shows that the proposed approach produces better seam carving results than the related existing methods.

[1]  Xueqing Li,et al.  Leveraging stereopsis for saliency analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[3]  Yong Man Ro,et al.  Predicting Visual Discomfort of Stereoscopic Images Using Human Attention Model , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Weisi Lin,et al.  Saliency detection for stereoscopic images , 2013, 2013 Visual Communications and Image Processing (VCIP).

[5]  Yuan Zhou,et al.  Improved seam carving for stereo image resizing , 2013, EURASIP J. Wirel. Commun. Netw..

[6]  Qionghai Dai,et al.  Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties , 2015, IEEE Transactions on Image Processing.

[7]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[8]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[9]  Takeshi Naemura,et al.  Seam carving for stereo images , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[10]  Chao-Hung Lin,et al.  Content-Aware Video Retargeting Using Object-Preserving Warping , 2013 .

[11]  Wei-Yang Lin,et al.  Image retargeting using RGB-D camera , 2013, Multimedia Tools and Applications.

[12]  Xuelong Li,et al.  Depth-Aware Image Seam Carving , 2013, IEEE Transactions on Cybernetics.

[13]  Ralph R. Martin,et al.  Changing Perspective in Stereoscopic Images , 2013, IEEE Transactions on Visualization and Computer Graphics.

[14]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Ken Chen,et al.  Depth perceptual region-of-interest based multiview video coding , 2010, J. Vis. Commun. Image Represent..

[16]  Junle Wang,et al.  Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli , 2012 .

[17]  Shai Avidan,et al.  Stereo Seam Carving a Geometrically Consistent Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Wolfgang Effelsberg,et al.  Saliency detection for stereoscopic video , 2013, MMSys.

[19]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[21]  Natasha Gelfand,et al.  A survey of image retargeting techniques , 2010, Optical Engineering + Applications.

[22]  Yong Man Ro,et al.  Visual Comfort Amelioration Technique for Stereoscopic Images: Disparity Remapping to Mitigate Global and Local Discomfort Causes , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Wu-chi Feng,et al.  Enabling warping on stereoscopic images , 2012, ACM Trans. Graph..

[24]  Alan C. Bovik,et al.  Saliency Prediction on Stereoscopic Videos , 2014, IEEE Transactions on Image Processing.

[25]  Weisi Lin,et al.  Objective Quality Assessment for Image Retargeting Based on Perceptual Geometric Distortion and Information Loss , 2014, IEEE Journal of Selected Topics in Signal Processing.

[26]  Yung-Yu Chuang,et al.  Scene warping: Layer-based stereoscopic image resizing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Wen-Huang Cheng,et al.  Perspective-aware warping for seamless stereoscopic image cloning , 2012, ACM Trans. Graph..

[28]  Jeffrey Ho,et al.  Shift-Map Based Stereo Image Retargeting with Disparity Adjustment , 2012, ACCV.

[29]  Kai Zeng,et al.  Objective Quality Assessment for Image Retargeting Based on Structural Similarity , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[30]  A. Aydin Alatan,et al.  User assisted disparity remapping for stereo images , 2013, Signal Process. Image Commun..

[31]  Junle Wang,et al.  Computational Model of Stereoscopic 3D Visual Saliency , 2013, IEEE Transactions on Image Processing.

[32]  Chao-Hung Lin,et al.  Object-Coherence Warping for Stereoscopic Image Retargeting , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[34]  Chee Sun Won,et al.  Stereo Video Retargeting with Representative Seams in a Group of Stereoscopic Frames , 2013 .

[35]  Wolfgang Effelsberg,et al.  Seam carving for stereoscopic video , 2013, IVMSP 2013.

[36]  Bo Yan,et al.  Matching-Area-Based Seam Carving for Video Retargeting , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Yung-Yu Chuang,et al.  Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images , 2011, IEEE Transactions on Multimedia.

[38]  Weisi Lin,et al.  Saliency Detection in the Compressed Domain for Adaptive Image Retargeting , 2012, IEEE Transactions on Image Processing.