Patch-Based Image Warping for Content-Aware Retargeting

Image retargeting is the process of adapting images to fit displays with various aspect ratios and sizes. Most studies on image retargeting focus on shape preservation, but they do not fully consider the preservation of structure lines, which are sensitive to human visual system. In this paper, a patch-based retargeting scheme with an extended significance measurement is introduced to preserve shapes of both visually salient objects and structure lines while minimizing visual distortions. In the proposed scheme, a similarity transformation constraint is used to force visually salient content to undergo as-rigid-as-possible deformation, while an optimization process is performed to smoothly propagate distortions. These processes enable our approach to yield pleasing content-aware warping and retargeting. Experimental results and a user study show that our results are better than those generated by state-of-the-art approaches.

[1]  Ligang Liu,et al.  Nonhomogeneous scaling optimization for realtime image resizing , 2010, The Visual Computer.

[2]  Olga Sorkine-Hornung,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH Asia '08.

[3]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[4]  ShamirAriel,et al.  Improved seam carving for video retargeting , 2008 .

[5]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[6]  ShamirAriel,et al.  Seam carving for content-aware image resizing , 2007 .

[7]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[9]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[10]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[12]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Ariel Shamir,et al.  Seam carving for media retargeting , 2009, CACM.

[14]  Jiaya Jia,et al.  Active Window Oriented Dynamic Video Retargeting , 2007 .

[15]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[16]  Michael Gleicher,et al.  Video retargeting: automating pan and scan , 2006, MM '06.

[17]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[18]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[19]  Peter Shirley,et al.  Fundamentals of computer graphics , 2018 .

[20]  Xiaodong Wu,et al.  Optimal multiple-seams search for image resizing with smoothness and shape prior , 2010, The Visual Computer.

[21]  Jian Shi,et al.  Image Retargeting Using Mesh Parametrization , 2009, IEEE Transactions on Multimedia.

[22]  Radomír Mech,et al.  Optimizing Structure Preserving Embedded Deformation for Resizing Images and Vector Art , 2009, Comput. Graph. Forum.

[23]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[24]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[25]  Olga Sorkine-Hornung,et al.  Visual media retargeting , 2009, SIGGRAPH ASIA Courses.

[26]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[27]  Yong-Jin Liu,et al.  Image Retargeting Quality Assessment , 2011, Comput. Graph. Forum.

[28]  Alexander Wong,et al.  Enhanced Seam Carving via Integration of Energy Gradient Functionals , 2011, IEEE Signal Processing Letters.

[29]  O. Sorkine,et al.  Motion-based video retargeting with optimized crop-and-warp , 2010, ACM Trans. Graph..

[30]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[31]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..