Seamlet carving for shape-aware image resizing

In this paper we propose an optimized seam-carving approach for anti-shearing image resizing. Current image/video seam-carving strategy only focuses on deleting the pixels along 8-connected seams, which may lead to the obvious information loss during resizing. Unlike the traditional seam-carving methods, our approach can construct a seamlet to handle the discontinuous pixels and further achieve an optimized image resizing results with shape-preservation. In particular, to suppress zigzag artifacts, we introduce the anti-shearing energy into the seamlet generation, which includes two steps: 1) the energy map is formalized by using Gabor filtering and the saliency map; 2) The energy computation is optimized in Gabor feature space to obtain the resizing results without the connectivity restriction. The experimental results and comparisons show the effectiveness of our method.

[1]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[2]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[3]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[4]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[5]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, SIGGRAPH 2010.

[6]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[8]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[10]  Wolfgang Effelsberg,et al.  FSCAV: fast seam carving for size adaptation of videos , 2009, ACM Multimedia.

[11]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[12]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[13]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[14]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[15]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, ACM Trans. Graph..

[16]  Long Quan,et al.  Image deblurring with blurred/noisy image pairs , 2007, SIGGRAPH 2007.

[17]  Vidya Setlur,et al.  Retargeting Images and Video for Preserving Information Saliency , 2007, IEEE Computer Graphics and Applications.

[18]  Ralph R. Martin,et al.  Shrinkability Maps for Content‐Aware Video Resizing , 2008, Comput. Graph. Forum.

[19]  Xing Xie,et al.  Automatic browsing of large pictures on mobile devices , 2003, MULTIMEDIA '03.

[20]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[21]  Hua Huang,et al.  Real-time content-aware image resizing , 2009, Science in China Series F: Information Sciences.

[22]  Hans-Peter Seidel,et al.  Video quality assessment for computer graphics applications , 2010, SIGGRAPH 2010.

[23]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[24]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[25]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[27]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[28]  Michael Gleicher,et al.  Video retargeting: automating pan and scan , 2006, MM '06.