Realtime Aesthetic Image Retargeting

Humans have always sought to achieve aesthetics in art. In this paper, we present a novel approach for retargeting images to different aspect ratios while improving the composition aesthetics of the results. A simpler computational aesthetic energy is proposed and used to drive the salient objects and prominent lines to move towards their corresponding optimal positions. A mesh-based warping scheme is presented to transform the images while protecting the visual appearance of salient objects. The objective function is quadratic and thus it can be quickly minimized by solving a sparse linear system. The retargeting results are generated in realtime while the user changes the aspect ratios of the target images. A variety of experiments have shown the applicability and effectiveness of our algorithm.

[1]  Ramesh Raskar,et al.  Automatic image retargeting , 2004, SIGGRAPH '04.

[2]  Olga Sorkine-Hornung,et al.  Visual media retargeting , 2009, SIGGRAPH ASIA Courses.

[3]  William D. Smart,et al.  Say Cheese! Experiences with a Robot Photographer , 2004, AI Mag..

[4]  Jian Shi,et al.  Image Retargeting Using Mesh Parametrization , 2009, IEEE Transactions on Multimedia.

[5]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[6]  Craig Gotsman,et al.  Energy‐Based Image Deformation , 2009, Comput. Graph. Forum.

[7]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[8]  S. Avidan,et al.  Multi-operator media retargeting , 2009, SIGGRAPH 2009.

[9]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[10]  Ligang Liu,et al.  Nonhomogeneous scaling optimization for realtime image resizing , 2010, The Visual Computer.

[11]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Manuel Menezes de Oliveira Neto,et al.  Real-time line detection through an improved Hough transform voting scheme , 2008, Pattern Recognit..

[13]  Florian Hönig.  Defining Computational Aesthetics , 2005, CAe.

[14]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[15]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[16]  Daniel Cohen-Or,et al.  Optimizing Photo Composition , 2010, Comput. Graph. Forum.

[17]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[18]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[19]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[20]  James Ze Wang,et al.  ACQUINE: aesthetic quality inference engine - real-time automatic rating of photo aesthetics , 2010, MIR '10.

[21]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[22]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[23]  D. Cohen-Or,et al.  Parametric reshaping of human bodies in images , 2010, ACM Trans. Graph..

[24]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[25]  Wei-Ying Ma,et al.  Auto cropping for digital photographs , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[26]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[28]  Steven K. Feiner,et al.  Evaluation of visual balance for automated layout , 2004, IUI '04.