Feedback Retargeting

Feedback retargeting combines the benefits of two previous retargeting methods: Bidirectional similarity [1] and Shift-Map [2]. The first method may have blurry areas due to patch averaging and the latter can remove entire objects. Feedback retargeting has the sharpness of shift-map and the completeness of bidirectional similarity, avoiding the removal of salient objects. In Shift-Map retargeting the output image is made from segments of the input image, and this minimizes the forward direction of bidirectional similarity. An iterative feedback procedure is developed to take care of the backward direction, assuring that the input image can be reconstructed from the output image. This is done by using Shift-Map backwards, reconstructing the input image back from the output image. Areas in the input image that are difficult to reconstruct from the output image get a feedback priority score. A second Shift-Map retargeting is then performed, adding this feedback priority to the data term. These regions now have a higher priority to be included in the output. After a few iterations of forward retargeting and backward feedback the retargeted image includes all salient features from the input image. Computational efficiency and image sharpness remain as high as in ordinary Shift-Map.

[1]  Michal Irani,et al.  Similarity by Composition , 2006, NIPS.

[2]  Eli Shechtman,et al.  Space-time video completion , 2004, CVPR 2004.

[3]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[5]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[6]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[7]  Brendan J. Frey,et al.  Epitomic analysis of appearance and shape , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Kun Zhou,et al.  Inverse texture synthesis , 2008, ACM Trans. Graph..

[9]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[11]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[13]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mads Nielsen,et al.  Computer Vision — ECCV 2002 , 2002, Lecture Notes in Computer Science.

[16]  Ramesh Raskar,et al.  Automatic image retargeting , 2004, SIGGRAPH '04.

[17]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[18]  Andrew Blake,et al.  Digital tapestry [automatic image synthesis] , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[20]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[21]  Deepu Rajan,et al.  Hybrid shift map for video retargeting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[23]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[24]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..