Learning Layouts for Single-PageGraphic Designs

This paper presents an approach for automatically creating graphic design layouts using a new energy-based model derived from design principles. The model includes several new algorithms for analyzing graphic designs, including the prediction of perceived importance, alignment detection, and hierarchical segmentation. Given the model, we use optimization to synthesize new layouts for a variety of single-page graphic designs. Model parameters are learned with Nonlinear Inverse Optimization (NIO) from a small number of example layouts. To demonstrate our approach, we show results for applications including generating design layouts in various styles, retargeting designs to new sizes, and improving existing designs. We also compare our automatic results with designs created using crowdsourcing and show that our approach performs slightly better than novice designers.

[1]  Donald E. Knuth,et al.  The TeXbook , 1984 .

[2]  Mahesh Viswanathan,et al.  Syntactic Segmentation and Labeling of Digitized Pages from Technical Journals , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Avon Murphy,et al.  The Non-designer's Design Book , 1995 .

[4]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[5]  Robin Landa,et al.  Graphic Design Solutions , 1996 .

[6]  Chris Stolte,et al.  Rendering effective route maps: improving usability through generalization , 2001, SIGGRAPH.

[7]  Lisa M. Graham Basics of Design: Layout and Typography for Beginners , 2001 .

[8]  Barry O'Sullivan,et al.  Creating personalized documents: an optimization approach , 2003, DocEng '03.

[9]  Azriel Rosenfeld,et al.  Document structure analysis algorithms: a literature survey , 2003, IS&T/SPIE Electronic Imaging.

[10]  Alexander C. Loui,et al.  Using Genetic Algorithms for Album Page Layouts , 2003, IEEE Multim..

[11]  David Salesin,et al.  Adaptive grid-based document layout , 2003, ACM Trans. Graph..

[12]  P. Roetling,et al.  Aesthetic measures for automated document layout , 2004, DocEng '04.

[13]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[14]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[15]  Krzysztof Z. Gajos,et al.  Preference elicitation for interface optimization , 2005, UIST.

[16]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[17]  Paul A. Viola,et al.  Learning nongenerative grammatical models for document analysis , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Shumeet Baluja,et al.  Browsing on small screens: recasting web-page segmentation into an efficient machine learning framework , 2006, WWW '06.

[19]  Daniel Vogel,et al.  Specifying label layout style by example , 2007, UIST.

[20]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Martin Wattenberg,et al.  An intuitive model of perceptual grouping for HCI design , 2009, CHI.

[23]  Wilmot Li,et al.  Review of automatic document formatting , 2009, DocEng '09.

[24]  Steve Caplin,et al.  Principles Of Design , 2011 .

[25]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Helen Balinsky,et al.  Aesthetically-driven layout engine , 2009, DocEng '09.

[27]  Helen Balinsky,et al.  Aesthetic measure of alignment and regularity , 2009, DocEng '09.

[28]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[30]  Daniel Cohen-Or,et al.  Optimizing Photo Composition , 2010, Comput. Graph. Forum.

[31]  David Vallejo-Fernandez,et al.  Gaudii: An Automated Graphic Design Expert System , 2010, IAAI.

[32]  Niranjan Damera-Venkata,et al.  Probabilistic document model for automated document composition , 2011, DocEng '11.

[33]  Ranjitha Kumar,et al.  Bricolage: example-based retargeting for web design , 2011, CHI.

[34]  Sebastian Nowozin,et al.  Structured Learning and Prediction in Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[35]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[36]  Chi-Keung Tang,et al.  Make it home: automatic optimization of furniture arrangement , 2011, ACM Trans. Graph..

[37]  Jan P. Allebach,et al.  Automatic design of magazine covers , 2012, Electronic Imaging.

[38]  Radomír Mech,et al.  Learning design patterns with bayesian grammar induction , 2012, UIST.