Region-based depth-preserving stereoscopic image retargeting

The popularity of stereo images and various sizes of display screens pose the need of stereo image retargeting techniques which resize stereo image pairs to desired sizes. Many content-aware stereo image retargeting methods adapt the images through non-uniformly resizing regions. However, these methods often make the depth of retargeted version inconsistent with the original one, since they do not explicitly consider different effects of resizing distinct regions on the depths of 3D scenes. In this paper, we analyze the effects of region-wise resizing on the depths of 3D scenes. With such insights, we can properly edit or maintain the depth of a stereo image pair via region-wise resizing. In addition, by taking into account the effects on different regions, we propose a grid-based retargeting model for stereo images, which simultaneously preserve the depths of 3D scenes and the shapes of salient objects. Experimental results demonstrate the superior performance of our method.

[1]  Wen Gao,et al.  Spatiotemporal Grid Flow for Video Retargeting , 2014, IEEE Transactions on Image Processing.

[2]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[3]  Yung-Yu Chuang,et al.  Scene warping: Layer-based stereoscopic image resizing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yung-Yu Chuang,et al.  A line-structure-preserving approach to image resizing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Wen Gao,et al.  Grid-Based Retargeting with Transformation Consistency Smoothing , 2011, MMM.

[6]  Takashi Shibata,et al.  Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict , 2011, Electronic Imaging.

[7]  Olga Sorkine-Hornung,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH Asia '08.

[8]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[9]  Olga Sorkine-Hornung,et al.  Robust Image Retargeting via Axis‐Aligned Deformation , 2012, Comput. Graph. Forum.

[10]  Yung-Yu Chuang,et al.  Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images , 2011, IEEE Transactions on Multimedia.

[11]  Wen Gao,et al.  Fast retargeting with adaptive grid optimization , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[12]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[13]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[14]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Sehoon Yea,et al.  Content-Driven Retargeting of Stereoscopic Images , 2013, IEEE Signal Processing Letters.

[16]  Shai Avidan,et al.  Stereo Seam Carving a Geometrically Consistent Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[18]  Chao-Hung Lin,et al.  Patch-Based Image Warping for Content-Aware Retargeting , 2013, IEEE Transactions on Multimedia.