Automatic Generation of Visual-Textual Presentation Layout

Visual-textual presentation layout (e.g., digital magazine cover, poster, Power Point slides, and any other rich media), which combines beautiful image and overlaid readable texts, can result in an eye candy touch to attract users’ attention. The designing of visual-textual presentation layout is therefore becoming ubiquitous in both commercially printed publications and online digital magazines. However, handcrafting aesthetically compelling layouts still remains challenging for many small businesses and amateur users. This article presents a system to automatically generate visual-textual presentation layouts by investigating a set of aesthetic design principles, through which an average user can easily create visually appealing layouts. The system is attributed with a set of topic-dependent layout templates and a computational framework integrating high-level aesthetic principles (in a top-down manner) and low-level image features (in a bottom-up manner). The layout templates, designed with prior knowledge from domain experts, define spatial layouts, semantic colors, harmonic color models, and font emotion and size constraints. We formulate the typography as an energy optimization problem by minimizing the cost of text intrusion, the utility of visual space, and the mismatch of information importance in perception and semantics, constrained by the automatically selected template and further preserving color harmonization. We demonstrate that our designs achieve the best reading experience compared with the reimplementation of parts of existing state-of-the-art designs through a series of user studies.

[1]  R. Arnheim Art and Visual Perception, a Psychology of the Creative Eye , 1967 .

[2]  Noriaki Muranaka,et al.  Color design support system considering color harmony , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[3]  Sheng Ma,et al.  Toward Applying Machine Learning to Design Rule Acquisition for Automated Graphics Generation , 1999 .

[4]  Jan P. Allebach,et al.  Automatic design of magazine covers , 2012, Electronic Imaging.

[5]  Jian Sun,et al.  Face Alignment Via Component-Based Discriminative Search , 2008, ECCV.

[6]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[7]  Alexander Kröner,et al.  The DesignComposer: Context-Based Automated Layout for the Internet , 1999 .

[8]  Daniel Cohen-Or,et al.  Color harmonization , 2006, ACM Trans. Graph..

[9]  David Salesin,et al.  Adaptive grid-based document layout , 2003, ACM Trans. Graph..

[10]  A. H. Munsell,et al.  Munsell book of color , 1950 .

[11]  Qiang Huo,et al.  Improving Chinese/English OCR performance by using MCE-based character-pair modeling and negative training , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[12]  Jan P. Allebach,et al.  Recommendation system for automatic design of magazine covers , 2013, IUI '13.

[13]  Pirkko Oittinen,et al.  Semi-automated magazine layout using content-based image features , 2012, ACM Multimedia.

[14]  Tao Mei,et al.  Automatic generation of social media snippets for mobile browsing , 2013, ACM Multimedia.

[15]  Tao Mei,et al.  ImageSense: Towards contextual image advertising , 2012, TOMCCAP.

[16]  Naila Murray,et al.  AVA: A large-scale database for aesthetic visual analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Natasha Gelfand,et al.  A survey of image retargeting techniques , 2010, Optical Engineering + Applications.

[18]  Munsell Color The munsell book of color , 1993 .

[19]  Catherine Havasi,et al.  Automated Color Selection Using Semantic Knowledge , 2010, AAAI Fall Symposium: Commonsense Knowledge.

[20]  Yili Liu,et al.  Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics , 2006, Int. J. Hum. Comput. Stud..

[21]  Steven K. Feiner,et al.  A Survey of Automated Layout Techniques for Information Presentations , 2005 .

[22]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[23]  Daniel Cohen-Or,et al.  Optimizing Photo Composition , 2010, Comput. Graph. Forum.

[24]  Shigenobu Kobayashi,et al.  Color Image Scale , 1992 .