Optimizing Photo Composition

Aesthetic images evoke an emotional response that transcends mere visual appreciation. In this work we develop a novel computational means for evaluating the composition aesthetics of a given image based on measuring several well‐grounded composition guidelines. A compound operator of crop‐and‐retarget is employed to change the relative position of salient regions in the image and thus to modify the composition aesthetics of the image. We propose an optimization method for automatically producing a maximally‐aesthetic version of the input image. We validate the performance of the method and show its effectiveness in a variety of experiments.

[1]  S. Avidan,et al.  Multi-operator media retargeting , 2009, SIGGRAPH 2009.

[2]  Benjamin Martinez,et al.  Visual Forces: An Introduction to Design , 1988 .

[3]  Daniel Cohen-Or,et al.  Color harmonization , 2006, ACM Trans. Graph..

[4]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[5]  William T. Freeman,et al.  The patch transform and its applications to image editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[7]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Wei-Ying Ma,et al.  Auto cropping for digital photographs , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[9]  Jirí Benes,et al.  On neural networks , 1990, Kybernetika.

[10]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[11]  Olga Sorkine-Hornung,et al.  Visual media retargeting , 2009, SIGGRAPH ASIA Courses.

[12]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[13]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[14]  O. Sorkine,et al.  Color harmonization , 2006, SIGGRAPH 2006.

[15]  Michael F. Cohen,et al.  Simultaneous Matting and Compositing , 2006, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[17]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[18]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[19]  Olga Sorkine-Hornung,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH Asia '08.

[20]  Ramesh Raskar,et al.  Automatic image retargeting , 2005, MUM '05.

[21]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[22]  William D. Smart,et al.  Say Cheese! Experiences with a Robot Photographer , 2004, AI Mag..

[23]  Yoichi Sato,et al.  Sensation-based photo cropping , 2009, ACM Multimedia.

[24]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[25]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[26]  Gabriele Peters,et al.  Aesthetic Primitives of Images for Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[27]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, ACM Trans. Graph..

[29]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[31]  Mario Costa Sousa,et al.  Composition Principles for Quality Depiction and Aesthetics , 2007, CAe.

[32]  John F. Hughes,et al.  User-guided composition effects for art-based rendering , 2001, I3D '01.

[33]  Harry Shum,et al.  Statistical Learning of Multi-view Face Detection , 2002, ECCV.

[34]  Steven K. Feiner,et al.  Evaluation of visual balance for automated layout , 2004, IUI '04.